{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T02:08:49Z","timestamp":1772762929508,"version":"3.50.1"},"reference-count":20,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T00:00:00Z","timestamp":1689811200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"NSF CRCNS","award":["BCS2011716"],"award-info":[{"award-number":["BCS2011716"]}]},{"name":"Swartz Foundation","award":["BCS2011716"],"award-info":[{"award-number":["BCS2011716"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Full-body motion capture is essential for the study of body movement. Video-based, markerless, mocap systems are, in some cases, replacing marker-based systems, but hybrid systems are less explored. We develop methods for coregistration between 2D video and 3D marker positions when precise spatial relationships are not known a priori. We illustrate these methods on three-ball cascade juggling in which it was not possible to use marker-based tracking of the balls, and no tracking of the hands was possible due to occlusion. Using recorded video and motion capture, we aimed to transform 2D ball coordinates into 3D body space as well as recover details of hand motion. We proposed four linear coregistration methods that differ in how they optimize ball-motion constraints during hold and flight phases, using an initial estimate of hand position based on arm and wrist markers. We found that minimizing the error between ball and hand estimate was globally suboptimal, distorting ball flight trajectories. The best-performing method used gravitational constraints to transform vertical coordinates and ball-hold constraints to transform lateral coordinates. This method enabled an accurate description of ball flight as well as a reconstruction of wrist movements. We discuss these findings in the broader context of video\/motion capture coregistration.<\/jats:p>","DOI":"10.3390\/s23146542","type":"journal-article","created":{"date-parts":[[2023,7,20]],"date-time":"2023-07-20T05:42:01Z","timestamp":1689831721000},"page":"6542","update-policy":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Approaches for Hybrid Coregistration of Marker-Based and Markerless Coordinates Describing Complex Body\/Object Interactions"],"prefix":"10.3390","volume":"23","author":[{"given":"Hyeonseok","family":"Kim","sequence":"first","affiliation":[{"name":"Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA"}]},{"given":"Makoto","family":"Miyakoshi","sequence":"additional","affiliation":[{"name":"Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA"},{"name":"Division of Child and Adolescent Psychiatry, Cincinnati Children\u2019s Hospital Medical Center, Cincinnati, OH 45229, USA"},{"name":"Department of Psychiatry, University of Cincinnati College of Medicine, Cincinnati, OH 45267, USA"}]},{"ORCID":"https:\/\/2.zoppoz.workers.dev:443\/https\/orcid.org\/0000-0002-4172-9848","authenticated-orcid":false,"given":"John Rehner","family":"Iversen","sequence":"additional","affiliation":[{"name":"Swartz Center for Computational Neuroscience, Institute for Neural Computation, University of California San Diego, La Jolla, CA 92093, USA"},{"name":"Department of Psychology, Neuroscience & Behaviour, McMaster University, Hamilton, ON L8S 4K1, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"587","DOI":"10.1016\/j.jbiomech.2013.11.031","article-title":"Accuracy and repeatability of joint angles measured using a single camera markerless motion capture system","volume":"47","author":"Schmitz","year":"2013","journal-title":"J. Biomech."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1186\/s12984-017-0270-x","article-title":"Markerless motion capture systems as training device in neurological rehabilitation: A systematic review of their use, application, target population and efficacy","volume":"14","author":"Knippenberg","year":"2017","journal-title":"J. Neuroeng. Rehabil."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"50","DOI":"10.3389\/fspor.2020.00050","article-title":"Evaluation of 3D markerless motion capture accuracy using openpose with multiple video cameras","volume":"2","author":"Nakano","year":"2020","journal-title":"Front. Sports Act. Living"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.jvcir.2008.11.008","article-title":"Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video","volume":"20","author":"Chen","year":"2009","journal-title":"J. Vis. Commun. Image Represent."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1007\/s11042-011-0833-y","article-title":"Ball tracking and 3D trajectory approximation with applications to tactics analysis from single-camera volleyball sequences","volume":"60","author":"Chen","year":"2012","journal-title":"Multimed. Tools Appl."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1164","DOI":"10.1109\/TMM.2006.884621","article-title":"Trajectory-Based Ball Detection and Tracking in Broadcast Soccer Video","volume":"8","author":"Yu","year":"2006","journal-title":"IEEE Trans. Multimed."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"166463","DOI":"10.1109\/ACCESS.2019.2953340","article-title":"Precise 3D baseball pitching trajectory estimation using multiple unsynchronized cameras","volume":"7","author":"Kim","year":"2019","journal-title":"IEEE Access"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1016\/j.ijpsycho.2008.11.008","article-title":"Linking brain, mind and behavior","volume":"73","author":"Makeig","year":"2009","journal-title":"Int. J. Psychophysiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"934","DOI":"10.1037\/0096-1523.18.4.934","article-title":"Temporal patterning in cascade juggling","volume":"18","author":"Beek","year":"1992","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/0167-9457(92)90063-H","article-title":"Inadequacies of the proportional duration model: Perspectives from a dynamical analysis of juggling","volume":"11","author":"Beek","year":"1992","journal-title":"Hum. Mov. Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1111\/1467-9590.00069","article-title":"Extending shannon\u2019s theorem to a general juggling pattern","volume":"100","author":"Yam","year":"1998","journal-title":"Stud. Appl. Math."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0001-6918(94)00044-1","article-title":"Spatiotemporal variability in cascade juggling","volume":"91","author":"Beek","year":"1996","journal-title":"Acta Psychol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1007\/PL00007966","article-title":"Principal components in three-ball cascade juggling","volume":"82","author":"Post","year":"2000","journal-title":"Biol. Cybern."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.humov.2004.08.003","article-title":"Temporal and spatial factors reflecting performance improvement during learning three-ball cascade juggling","volume":"23","author":"Hashizume","year":"2004","journal-title":"Hum. Mov. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1080\/14763141.2012.734321","article-title":"Professional tennis players\u2019 serve: Correlation between segmental angular momentums and ball velocity","volume":"12","author":"Martin","year":"2013","journal-title":"Sports Biomech."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"779","DOI":"10.1177\/03635465221144020","article-title":"Changes in Elbow Stress and Ball Velocity During Reduced Effort Pitching: A Marker-Based Motion Capture Analysis","volume":"51","author":"Fiegen","year":"2023","journal-title":"Am. J. Sports Med."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"130714","DOI":"10.1155\/2011\/130714","article-title":"EEGLAB, SIFT, NFT, BCILAB, and ERICA: New tools for advanced EEG processing","volume":"2011","author":"Delorme","year":"2011","journal-title":"Comput. Intell. Neurosci."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1145\/361237.361242","article-title":"Use of the Hough transformation to detect lines and curves in pictures","volume":"15","author":"Duda","year":"1972","journal-title":"Commun. ACM"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1007\/BF02521480","article-title":"Geodetic reference system 1980","volume":"54","author":"Moritz","year":"1980","journal-title":"Bull. Geod."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"31","DOI":"10.22266\/ijies2018.0831.04","article-title":"Feature descriptor based identity retention and tracking of players under intense occlusion in soccer videos","volume":"11","author":"Israni","year":"2018","journal-title":"IJIES"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/23\/14\/6542\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:15:24Z","timestamp":1760127324000},"score":1,"resource":{"primary":{"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/www.mdpi.com\/1424-8220\/23\/14\/6542"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,20]]},"references-count":20,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2023,7]]}},"alternative-id":["s23146542"],"URL":"https:\/\/2.zoppoz.workers.dev:443\/https\/doi.org\/10.3390\/s23146542","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,20]]}}}