Tactile sensing remains fundamental for enabling dexterous robotic manipulation and safe human–robot interaction. Existing visuotactile sensors often compromise either deformation depth or optical transparency, limiting their ability to capture both contact forces and external scene information. This paper presents DigitEye, a transparent soft tactile sensor with a hollow box-shaped silicone rubber skin that deforms at the centimeter scale while preserving high optical clarity. A one-shot molding process with inner-frame grooves ensures robust adhesion and modular replacement of the soft skin, while dark-blue markers embedded through CNC-machined molds enable reliable tracking under varied conditions. To validate the design, we constructed two benchmark datasets: a force-sensing dataset linking images to indentation depth and ground-truth force, and an object detection dataset of fruits under varying distances and lighting. Experimental evaluations demonstrate reliable force estimation across multiple contact geometries, together with YOLO-based recognition, achieving a precision of 0.95, a recall of 0.87, and an mAP@0.5 of 0.689. These results highlight DigitEye as a practical platform for transparent visuotactile sensing, supporting both fine-grained contact perception and safer robotic operation in unstructured environments.
REFERENCES(35)
1.
YUAN W., DONG S., ADELSON E.H., 2017, Gelsight: High-Resolution Robot Tactile Sensors for Estimating Geometry and Force, Sensors, 17/12, 2762.
TAYLOR I.H., DONG S., RODRIGUEZ A., 2022, Gelslim 3.0: High-Resolution Measurement of Shape, Force and Slip in a Compact Tactile-Sensing Finger, Proc. IEEE Int. Conf. Robot. Autom., (ICRA), 10781–10787.
LAMBETA M., CHOU P.W., TIAN S., YANG B., MALOON B., MOST V.R., CALANDRA R., 2020, Digit: A Novel Design for a Low-Cost Compact High-Resolution Tactile Sensor with Application to In-Hand Manipulation, IEEE Robot. Autom. Lett., 5/3, 3838–3845.
NGUYEN N.H., LE N.M.D., LUU Q.K., NGUYEN T.T., HO V.A., 2025, Vi2TaP: a Cross-Polarization Based Mechanism for Perception Transition in Tactile–Proximity Sensing with Applications to Soft Grippers, IEEE Robot. Autom. Lett., 6288–6295.
ITURRI J., XUE L., KAPPL M., GARCIA-FERNANDEZ L., BARNES W.J.P., BUTT H.J., DEL CAMPO A., 2015, Torrent Frog-Inspired Adhesives: Attachment to Flooded Surfaces, Adv. Funct. Mater., 25/10, 1499–1505.
LUU Q.K., NGUYEN D.Q., NGUYEN N.H., HO V.A., 2023, Soft Robotic Link with Controllable Transparency for Vision-Based Tactile and Proximity Sensing, Proc. IEEE Int. Conf. Soft Robot. (RoboSoft).
ZHANG S., SUN Y., LIU N., SUN F., YANG Y., FANG B., 2024, An Improved Vision-Based Tactile Skin with Imaging Adjustment System to Reduce Defocusing Caused by Contact Depth Changes, Sens. Actuators A: Phys., 374, 115495.
REKAVANDI A.M., RASHIDI S., BOUSSAID F., HOEFS S., AKBAS E., BENNAMOUN M., 2025, Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Art, ACM Comput. Surv., 58/3, 1–33.
TAO W., WANG X., YAN T., LIU Z., WAN S., 2024, ESF-YOLO: An Accurate and Universal Object Detector Based on Neural Networks, Front. Neurosci., 18, 1371418.
LUU Q.K., NGUYEN D.Q., NGUYEN N.H., DAM N.P., HO V.A., 2025, Vision-Based Proximity and Tactile Sensing for Robot Arms: Design, Perception, and Control, IEEE Trans. Robot., early access, 1–12.
DO W.K., JUREWICZ B., KENNEDY III M., 2022, Densetact 2.0: Optical Tactile Sensor for Shape and Force Reconstruction, arXiv preprint, arXiv:2209.10122.
LU Z., GAO X., YU H., 2022, Gtac: A Biomimetic Tactile Sensor with Skin-Like Heterogeneous Force Feedback for Robots, IEEE Sens. J., 22/14, 14491–14500.
ZHANG L., WANG Y., JIANG Y., 2022, Tac3D: A Novel Vision-Based Tactile Sensor for Measuring Forces Distribution and Estimating Friction Coefficient Distribution, arXiv preprint, arXiv:2202.06211.
SHI Y., LÜ X., WANG W., ZHOU X., ZHU W., 2024, A High-Repeatability Three-Dimensional Force Tactile Sensing System for Robotic Dexterous Grasping and Object Recognition, Micromachines, 15/12, 1513.
LE SIGNOR T., DUPRE N., DIDDEN J., LOMAKIN E., CLOSE G., 2023, Mass-Manufacturable 3D Magnetic Force Sensor for Robotic Grasping and Slip Detection, Sensors, 23/6, 3031.
ZHANG W., XI Y., WANG E., QU X., YANG Y., FAN Y., LI Z., 2022, Self-Powered Force Sensors for Multidimensional Tactile Sensing, ACS Appl. Mater. Interfaces, 14/17, 20122–20131.
LIU Y., HAN H., MO Y., WANG X., LI H., ZHANG J., 2022, A Flexible Tactile Sensor Based on Piezoresistive Thin Film for 3D Force Detection, Rev. Sci. Instrum., 93/8.
CHEN H., YANG X., WANG P., GENG J., MA G., WANG X., 2022, A Large-Area Flexible Tactile Sensor for Multi-Touch and Force Detection Using Electrical Impedance Tomography, IEEE Sens. J., 22/7, 7119–7129.
NGUYEN D.H., TRONG H.D., NGUYEN H.L.P., NGUYEN Q.K., TRAN D.T., BUI T.S., NGUYEN V.T., 2024, A Solution for Anomaly Detection of Red Beans in a Product Processing Line, Proc. Asia Pacific Signal and Information Processing Association Annual Summit and Conf. (APSIPA ASC), Macao, 1–5, https://doi.org/10.1109/APSIPA....
TRUNG D.D., 2021, Application of TOPSIS and PIV Methods for Multi-Criteria Decision Making in Hard Turning Process, J. Mach. Eng., 21/4, 57–71, https://doi.org/10.36897/jme/1....
BUI S., KAWANO S., HO V.A., 2023, Rose: Rotation-Based Squeezing Robotic Gripper Toward Universal Handling of Objects, Proc. Robotics: Science and Systems XIX (RSS2023), Daegu, South Korea, 1–9, https://doi.org/10.15607/rss.2....
We process personal data collected when visiting the website. The function of obtaining information about users and their behavior is carried out by voluntarily entered information in forms and saving cookies in end devices. Data, including cookies, are used to provide services, improve the user experience and to analyze the traffic in accordance with the Privacy policy. Data are also collected and processed by Google Analytics tool (more).
You can change cookies settings in your browser. Restricted use of cookies in the browser configuration may affect some functionalities of the website.