Looking through a fingertip Looking through a fingertip Barry L. Richardson, Mark A. Symmons, Dianne B. Wuillemin & George H. Van Doorn %LRQLFVDQG&RJQLWLYH6FLHQFH&HQWUH6FKRRORI +XPDQLWLHV&RPPXQLFDWLRQVDQG6RFLDO6FLHQFHV0RQDVK8QLYHUVLW\&KXUFKLOO$XVWUDOLD (PDLOEDUU\ULFKDUGVRQ#DUWVPRQDVKHGXDX $EVWUDFW 7KH VSDWLRWHPSRUDO SDWKZD\V IROORZHG GXULQJ DFWLYH KDSWLF H[SORUDWLRQ RI UDLVHGOLQH OHWWHUV ZHUH UHFRUGHG DQG WKHQ XVHG WR FRPSDUH KDSWLF SDVVLYH JXLGHG DQG YLVXDO LGHQWLILFDWLRQ RI WKH OHWWHUV ,Q WKH YLVXDO FRQGLWLRQV WKH SDWKZD\UHFRUGLQJVZHUHHLWKHUWUDFHGRXWLQFPOLQHVHJPHQWV WRUHYHDOWKH VKDSHRIWKHOHWWHUVPRYLQJZLQGRZFRQGLWLRQRUWKHOLQHVZHUH SDVVHGEHKLQG DVWDWLRQDU\ZLQGRZRIFPGLDPHWHU,QWKHKDSWLF FRQGLWLRQVVXEMHFWV¶ILQJHUV ZHUHSDVVLYHO\JXLGHGLQDQDQDORJXHRIWKHPRYLQJZLQGRZFRQGLWLRQRUZHUH KHOGVWDWLRQDU\ZKLOHWKHOHWWHUGUDZLQJVZHUHSDVVHGEHQHDWKWKHLU ILQJHUWLSV /HWWHULGHQWLILFDWLRQZDVIDVWHULQWKHPRYLQJZLQGRZFRQGLWLRQV EXW KDSWLF DQG YLVXDOSHUIRUPDQFHGLGQRWGLIIHU ([SHULPHQW 7KHSUHUHFRUGHGPRYHPHQWSDWKZD\VXVHGDVVWLPXOLZHUHPDGHE\DQ H[SHULPHQWHU GXULQJ DFWLYH KDSWLF H[SORUDWLRQ RI OHWWHUV XVLQJ WKH 7DFWLOH 'LVSOD\6\VWHP7'6GHVFULEHGLQGHWDLOHOVHZKHUH>@,QWKH ILUVWKDSWLF FRQGLWLRQWKH7'6JXLGHGDILQJHUWLSSDVVLYHO\DURXQGWKHUHFRUGHGSDWKZD\ ZKLOHWKHOHWWHUZDVIHOW FXWDQHRXVO\,QWKHVHFRQGKDSWLFFRQGLWLRQWKHVH UHFRUGLQJV ZHUH XVHG WR PRYH WKH GUDZLQJV XQGHU WKHVXEMHFW¶VVWDWLRQDU\ ILQJHUWLS 7KH VXEMHFWV¶ Q WDFWLOH H[SHULHQFH ZDV WKH VDPH LQ ERWK FRQGLWLRQVEXWLQWKHVHFRQGWKHUHZHUHQRNLQHVWKHWLF FXHV ,Q WKH YLVXDO FRQGLWLRQV SDUWLFLSDQWV VDZ VLPLODU OHWWHUV SURJUHVVLYHO\ GLVSOD\HG RQ D FRPSXWHU PRQLWRU ,Q WKH µPRYLQJ KROH¶ FRQGLWLRQ D  FP VHJPHQWRIOLQHWUDFHGRXWWKHOHWWHUDFFRUGLQJWRKRZWKHH[SHULPHQWHUKDG KDSWLFDOO\ H[SORUHGLW,QWKHµVWDWLRQDU\KROH¶FRQGLWLRQWKHFPVHJPHQWRIOLQH UHPDLQHG LQ WKH FHQWUH RI WKH VFUHHQ DQG DSSHDUHG WR µGDQFH¶ DQ HIIHFW VLPLODUWRPRYLQJDGUDZLQJEHKLQGDVWDWLRQDU\KROH 5HVXOWVDQG'LVFXVVLRQ $OOOHWWHUVZHUHFRUUHFWO\LGHQWLILHGLQERWKWKHYLVXDODQGKDSWLFFRQGLWLRQVEXW DQ$129$VKRZHGPHDQODWHQFLHVZHUHVKRUWHULQWKHFRQGLWLRQVLQYROYLQJ PRYHPHQWRIWKHKROHRUILQJHUWKDQLQWKH³VWDWLRQDU\´FRQGLWLRQVVHFV DQGVHFVUHVSHFWLYHO\S7KLVZDVQRWWRRVXUSULVLQJ EXWZHDOVR IRXQG WKH PHDQ YLVXDO ODWHQFLHV  VHFV WR EH QRW VLJQLILFDQWO\VKRUWHU S!WKDQKDSWLFODWHQFLHVVHFV ± DILQGLQJQRWFRQVLVWHQWZLWKPRVW SUHYLRXVUHVHDUFKLQZKLFKYLVXDOVXSHULRULW\LVUHSRUWHG,WFRXOGEHDUJXHG WKDWYLVLRQZDVGLVDGYDQWDJHGE\EHLQJVKRZQQRWWKH OHWWHUEXWWKH SDWKZD\ WDNHQE\DILQJHUWLSGXULQJDFWLYHH[SORUDWLRQRIWKHOHWWHU ± QRWTXLWHWKHVDPH WKLQJV ,Q FRQWUDVW LQ WKHSDVVLYHJXLGHGKDSWLFFRQGLWLRQ WKH DFWXDOOHWWHU FRXOGEHIHOWWDFWXDOO\DVDOLQHZKLOHWKHUHFRUGHGSDWKZD\ZDVH[SHULHQFHG DVNLQHVWKHWLF LQIRUPDWLRQSURYLGHGE\WKHJXLGLQJPRYHPHQWVRIWKH7'6 ([SHULPHQW 7R UHPRYH D SRVVLEOH KDSWLF DGYDQWDJH H[SORUDWLRQ SDWKZD\V ZHUH DJDLQ SUHVHQWHG EXW WKLV WLPH DV JURRYHV DORQJ ZKLFK D 3KDQWRP JXLGHG WKH VXEMHFWVOHDYLQJRQO\ NLQHVWKHWLF SDWKZD\FXHVIRUWKHKDSWLFFRQGLWLRQDQG QRFXWDQHRXVLQIRUPDWLRQDERXWWKHDFWXDOOHWWHU)RUYLVLRQWKHPRYLQJDQG VWDWLRQDU\ZLQGRZFRQGLWLRQVZHUHWKHVDPHDVWKRVHXVHGLQ([SHULPHQW 1RWH A short piece of video can be found on the proceedings CD to accompany this poster. It demonstrates the visual ouput of a haptic movement. ,QWURGXFWLRQ ,WLVRIWHQXVHIXOWRNQRZKRZYLVLRQDQG KDSWLFV SHUIRUPVHSDUDWHO\ZKHQ LQWHUSUHWLQJGDWDDERXWKRZWKH\ZRUNWRJHWKHURULQFRPSHWLWLRQ+RZHYHULW KDV SURYHQ GLIILFXOW WR GHYLVH IDLU WHVWV >@ 7DVNV WKDW KDYH EHHQ XVHG WR FRPSDUH YLVXDO DQG KDSWLF SURFHVVHV PXVW WDNH DFFRXQW RI WKH IDFW WKDW KDSWLFDOO\ ZHQRUPDOO\LQWHJUDWHVHJPHQWVRIDOLQHGUDZLQJRYHUWLPHZKLOH YLVXDOO\ZHPD\DSSUHKHQGDOOVHFWLRQVRIDGUDZLQJDOPRVWVLPXOWDQHRXVO\ 6RPH UHVHDUFKHUV KDYH XVHG DUUD\V RI YLEUDWRUV IRU WRXFK DQG D FRUUHVSRQGLQJDUUD\RIOLJKWVIRUYLVLRQ>@DQGRWKHUVDVPDOOILQJHUVL]HG KROHLQDQXSSHUVXUIDFHWKDWPRYHGWRUHYHDOGRWVXQGHUQHDWKRUWKURXJK ZKLFKPRYLQJGRWVFRXOGEHVHHQRUIHOW>@+XJKHVHWDO>@VXJJHVWWKDW LQIRUPDWLRQ LQ D VWLPXOXV FRXOG EH FRQVLGHUHG DPRGDO LI WKH LQIRUPDWLRQ LV FDUULHGE\VSDWLRWHPSRUDOSDWWHUQVRIVWLPXODWLRQWKDWH[KLELWWKHVDPHIRUP DQG WKH LQIRUPDWLRQ DIIRUGV GLIIHUHQW SHUFHSWXDO V\VWHPV ZLWK HTXLYDOHQW GHVFULSWLRQVRIHQYLURQPHQWDOVWDWHVRUHYHQWVS$OWKRXJKVRPHVWXGLHV DSSHDUWRKDYHVDWLVILHGWKHVHFRQGLWLRQVQRQHDSSHDUWRDOORZ DFRPSDULVRQ RI REMHFW LGHQWLILFDWLRQ EDVHG RQ DFWXDO  OLQHV GHSLFWLQJ REMHFWV  ,Q WKH H[SHULPHQWV UHSRUWHG KHUH OLQH GUDZLQJV RI OHWWHUV ZHUH SUHVHQWHG ERWK KDSWLFDOO\ DQGYLVXDOO\&RQVLVWHQWZLWKWKHVXJJHVWLRQRI+XJKHVHWDOWKH YLVXDO WDVN ZDV PRGLILHG WR VLPXODWH WKH IRUP LQ ZKLFK WKH KDSWLF V\VWHP UHFHLYHGLQIRUPDWLRQ,QVWHDGRIGRWVWREHLQWHJUDWHGLQWRSDWWHUQVZHXVHG VHJPHQWVRIOLQHVWRIRUPFDSLWDOOHWWHUV,QWKH KDSWLF FRQGLWLRQVWKHOHWWHUV FRXOG EH IHOW ZKLOH LQ WKH YLVXDO FRQGLWLRQ WKH\ ZHUH WUDFHG RXWRQD3& PRQLWRUEXWRQO\FPRIDOLQHPDNLQJXSDOHWWHUFRXOGEHVHHQRUIHOWDWDQ\ RQHWLPH7KXVDµILQJHUWLSVL]HZLQGRZ¶ ZDVSUHVHQWHGYLVXDOO\DQGZKDWZDV VHHQZDVQRWWKHOHWWHULWVHOIEXWDOLQHVKRZLQJZKHUHDILQJHUKDGPRYHG ZKLOHH[SORULQJWKHUDLVHGOLQHOHWWHUSUHVHQWHGKDSWLFDOO\ 5HVXOWVDQG'LVFXVVLRQ $OOHLJKWHHQSDUWLFLSDQWVFRUUHFWO\LGHQWLILHGDWOHDVWWZRRIWKHWKUHHOHWWHUV 7KHPHDQODWHQF\RILGHQWLILFDWLRQLQWKHYLVXDOVWDWLRQDU\KROH FRQGLWLRQ VHFZDVVLJQLILFDQWO\JUHDWHUWKDQWKRVHIRUWKHYLVXDODQGKDSWLFPRYLQJKROH FRQGLWLRQVVHFDQGVHFUHVSHFWLYHO\ZKLFKGLGQRW WKHPVHOYHV GLIIHU VLJQLILFDQWO\ GHVSLWH WKHUH EHLQJ NLQHVWKHWLF LQIRUPDWLRQ DORQH LQ WKH KDSWLFFRQGLWLRQDQGDVLQJOHSRLQWRIFRQWDFWEHWZHHQWKH3KDQWRPSUREH DQG WKH VWLPXOXV ,W ZRXOG EH LQWHUHVWLQJ WR SUHVHQW WKH DQDORJXH RI WKLV YLVXDOO\ DV D PRYLQJ GRW DQG DJDLQ FRPSDUH YLVXDO DQG KDSWLF OHWWHU UHFRJQLWLRQ ,WZRXOGDSSHDUIURPWKHVHUHVXOWVWKDWZKHQGHPDQGVDUHPDGHRQ PHPRU\VXFKWKDWPDWFKHGVSDWLDOLQIRUPDWLRQLVVXFFHVVLYHO\UHYHDOHGLQ FPOLQHVHJPHQWVWKHPRGDOLW\RILQSXWLVOHVVLPSRUWDQWWKDQLVWKHQDWXUHRI PRYHPHQWLQYROYHG7KLVLVFRQVLVWHQWZLWKWKHH[LVWHQFHRIDVSDWLDOFHQWUHLQ WKHEUDLQDFFHVVLEOHWRERWKYLVLRQDQGKDSWLFV7KHUHVXOWVDOVRVXJJHVW VRPHSUHYLRXVXQGHUHVWLPDWLRQRIKDSWLFSHUFHSWXDOSURFHVVHV 5HIHUHQFHV >@%+XJKHV:(SVWHLQ66FKQHLGHUDQG$'XGRFN ³$QDV\PPHWU\LQ WUDQVPRGDOSHUFHSWXDOOHDUQLQJ´ 3HUFHSWLRQ  3V\FKRSK\VLFV   >@3$SNDULDQ6WLHODXDQG-0/RRPLV³$FRPSDULVRQRIWDFWLOHDQGEOXUUHG YLVXDOIRUPSHUFHSWLRQ´3HUFHSWLRQ3V\FKRSK\VLFV >@ 1& 1ROO DQG 5- :HEHU ³9LVXDO DQG WDFWLOH VFDQQLQJ 0RYLQJ VFDQ YHUVXVPRYLQJPHGLXP´ %XOOHWLQ RI WKH 3V\FKRQRPLF 6RFLHW\   >@%/5LFKDUGVRQ06\PPRQVDQG5$FFDUGL ³7KH7'6$QHZGHYLFH IRU FRPSDULQJ DFWLYH DQG SDVVLYHJXLGHG WRXFK´ ,((( 7UDQVDFWLRQV RQ 5HKDELOLWDWLRQ(QJLQHHULQJ )LJ7KH7DFWLOH'LVSOD\6\VWHPXVHGIRUKDSWLF FRQGLWLRQVLQ([SHULPHQW )LJ([DPSOHRIFPSDWKZD\VHJPHQWGLVSOD\HG IRUYLVXDOFRQGLWLRQVLQ([SHULPHQWVDQG