Citation: Libin Li, Zhen Gu, Jia-Le Zhou, Bingyong Yan, Cong Kong, Hua Wang, Hui-Feng Wang. Intelligent droplet tracking with correlation filters for digital microfluidics[J]. Chinese Chemical Letters, ;2021, 32(11): 3416-3420. doi: 10.1016/j.cclet.2021.05.002 shu

Intelligent droplet tracking with correlation filters for digital microfluidics

Libin Li ^{a, 1} ,
Zhen Gu ^{a, 1,} ,
Jia-Le Zhou ^a ,
Bingyong Yan ^a ,
Cong Kong ^b ,
Hua Wang ^c ,
Hui-Feng Wang ^a

a.
Key Laboratory of Advanced Control and Optimization for Chemical Processes Ministry of Education, East China University of Science and Technology, Shanghai 200237, China
b.
Key Laboratory of East China Sea Fishery Resources Exploitation, Ministry of Agriculture and Rural Affairs, East China Sea Fisheries Research Institute, Chinese Academy of Fishery Sciences, Shanghai 200090, China
c.
Department of Laboratory Medicine, Renji Hospital, School of Medicine, Shanghai Jiao Tong University, Shanghai 200137, China

guzhen@ecust.edu.cn

Received Date: 21 January 2021
Revised Date: 18 March 2021
Accepted Date: 7 May 2021
Available Online: 14 May 2021

Figures(5)

Tracking the movement of droplets in digital microfluidics is essential to improve its control stability and obtain dynamic information for its applications such as point-of-care testing, environment monitoring and chemical synthesis. Herein, an intelligent, accurate and fast droplet tracking method based on machine vision is developed for applications of digital microfluidics. To continuously recognize the transparent droplets in real-time and avoid the interferes from background patterns or inhomogeneous illumination, we introduced the correlation filter tracker, enabling online learning of the multi-features of the droplets in Fourier domain. Results show the proposed droplet tracking method could accurately locate the droplets. We also demonstrated the capacity of the proposed method for estimation of the droplet velocity as faster as 20 mm/s, and its application in online monitoring the Griess reaction for both colorimetric assay of nitrite and study of reaction kinetics.
- Digital microfluidics,
- Correlation filter trackers,
- Machine vision,
- Reaction kinetics,
- Colorimetric assay
1. [1]
  J. Zhong, J. Riordon, T.C. Wu, et al., Lab Chip 20(2020) 709-716. doi: 10.1039/C9LC01042D
2. [2]
  W. Wang, X. Rui, W. Sheng, et al., Sens. Actuators B: Chem. 324(2020) 128763. doi: 10.1016/j.snb.2020.128763
3. [3]
  J. Guo, L. Lin, K. Zhao, et al., Lab Chip 20(2020) 1577-1585. doi: 10.1039/D0LC00024H
4. [4]
  A.T. Jafry, H. Lee, A.P. Tenggara, et al., Sens. Actuators B: Chem. 282(2019) 831-837. doi: 10.1016/j.snb.2018.11.135
5. [5]
  X. Min, C. Bao, W.S. Kim, ACS Sens. 4(2019) 918-923. doi: 10.1021/acssensors.8b01689
6. [6]
  T. Loveless, J. Ott, P. Brisk, CGO 2020: Proceedings of the 18^th ACM/IEEE International Symposium on Code Generation and Optimization, 2020, pp. 171-184.
7. [7]
  M. Alistar, U. Gaudenz, Bioeng. 4(2017) 45. doi: 10.3390/bioengineering4020045
8. [8]
  G. Sathyanarayanan, M. Haapala, C. Dixon, A.R. Wheeler, T.M. Sikanen, Adv. Mater. Technol. 5(2020) 2000451. doi: 10.1002/admt.202000451
9. [9]
  C. Dixon, J. Lamanna, A.R. Wheeler, Lab Chip 20(2020) 1845-1855. doi: 10.1039/D0LC00302F
10. [10]
  R.S. Sista, R. Ng, M. Nuffer, et al., Diagnostics 10(2020) 21. doi: 10.3390/diagnostics10010021
11. [11]
  M.S. Lee, W. Hsu, H.Y. Huang, et al., Biosens. Bioelectron. 150(2020) 111851. doi: 10.1016/j.bios.2019.111851
12. [12]
  P.Y. Keng, S. Chen, H. Ding, et al., Proc. Natl. Acad. Sci. USA. 109(2012) 690-695. doi: 10.1073/pnas.1117566109
13. [13]
  J. Lamanna, E.Y. Scott, H.S. Edwards, et al., Nat. Commun. 11(2020) 5632. doi: 10.1038/s41467-020-19394-5
14. [14]
  X. Xu, Q. Zhang, J. Song, et al., Anal. Chem. 92(2020) 8599-8606. doi: 10.1021/acs.analchem.0c01613
15. [15]
  A.H.C. Ng, M.D. Chamberlain, H. Situ, V. Lee, A.R. Wheeler, Nat. Commun. 6(2015) 7513. doi: 10.1038/ncomms8513
16. [16]
  J. Zhai, H. Li, A.H.H. Wong, et al., Microsyst. Nanoeng. 6(2020) 1-10. doi: 10.1038/s41378-019-0121-y
17. [17]
  S.M. Lu, Y.Y. Peng, Y.L. Ying, Y.T. Long, Anal. Chem. 92(2020) 5621-5644. doi: 10.1021/acs.analchem.0c00931
18. [18]
  K. Sun, C. Zhao, X. Zeng, et al., Nat. Commun. 10(2019) 5083. doi: 10.1038/s41467-019-13047-y
19. [19]
  K.C. Neuman, A. Nagy, Nat. Methods 5(2008) 491-505. doi: 10.1038/nmeth.1218
20. [20]
  N. Yang, X. Liu, X. Zhang, et al., Sens. Actuators A 219(2014) 6-12. doi: 10.1016/j.sna.2014.06.004
21. [21]
  S. Mukherjee, I. Pan, T. Samanta, Algorithm for fault localization on a digital microfluidic biochip using particle swarm optimization technique, in: 2016 IEEE International Symposium on Circuits and Systems (ISCAS), 2016, pp. 602-605.
22. [22]
  I. Swyer, R. Fobel, A.R. Wheeler, Langmuir 35(2019) 5342-5352. doi: 10.1021/acs.langmuir.9b00220
23. [23]
  A.D. Ruvalcaba-Cardenas, P. Thurgood, S. Chen, K. Khoshmanesh, F.J. Tovar-Lopez, ACS Appl. Mater. Interfaces 11(2019) 39283-39291. doi: 10.1021/acsami.9b10796
24. [24]
  M. Li, C. Dong, M.K. Law, et al., Sens. Actuators B: Chem. 287(2019) 390-397. doi: 10.1016/j.snb.2019.02.021
25. [25]
  R. Fobel, C. Fobel, A.R. Wheeler, Appl. Phys. Lett. 102(2013) 193513. doi: 10.1063/1.4807118
26. [26]
  C. Li, K. Zhang, X. Wang, et al., Sens. Actuators B: Chem. 255(2018) 3616-3622. doi: 10.1016/j.snb.2017.09.071
27. [27]
  S. Han, X. Liu, L. Wang, Y Wang, G Zheng, MethodsX 6(2019) 1443-1453. doi: 10.1016/j.mex.2019.06.006
28. [28]
  Q. Zhu, Y. Lu, S. Xie, et al., Microfluid Nanofluidics 24(2020) 1-9. doi: 10.1007/s10404-019-2306-y
29. [29]
  Y.J. Shin, J.B. Lee, Rev. Sci. Instrum. 81(2010) 014302. doi: 10.1063/1.3274673
30. [30]
  P.Q.N. Vo, M.C. Husser, F. Ahmadi, H. Sinha, S.C.C. Shih, Lab Chip 17(2017) 3437-3446. doi: 10.1039/C7LC00826K
31. [31]
  M. Willsey, K. Strauss, L. Ceze, et al., Puddle: a dynamic, error-correcting, full-stack microfluidics platform, in: ASPLOS '19: Proceedings of the Twenty-Fourth International Conference on Architectural Support for Programming Languages and Operating Systems, April 2019, pp. 183-197.
32. [32]
  D.S. Bolme, J.R. Beveridge, B.A. Draper, Y.M. Lui, Visual object tracking using adaptive correlation filters, in: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2010, pp. 2544-2550.
33. [33]
  M. Danelljan, F. Shahbaz Khan, M. Felsberg, J.V.D. Weijer, Adaptive color attributes for real-time visual tracking, in: 2014 IEEE Conference on Computer Vision and Pattern Recognition, 2014, pp. 1090-1097.
34. [34]
  J.F. Henriques, R. Caseiro, P. Martins, J. Batista, IEEE Trans. Pattern Anal. Mach. Intell. 37(2015) 583-596. doi: 10.1109/TPAMI.2014.2345390
35. [35]
  Y. Li, J. Zhu, A scale adaptive kernel correlation filter tracker with feature integration, in: Computer Vision-ECCV 2014 Workshops, 2015, pp. 254-265.
36. [36]
  The source code is available at https://github.com/ecustdmf/MV4DMF.
37. [37]
  Z. Gu, M.L. Wu, B.Y. Yan, H.F. Wang, C. Kong, ACS Omega 5(2020) 11196-11201. doi: 10.1021/acsomega.0c01274
38. [38]
  S. Liu, D. Liu, G. Srivastava, D. Polap, M. Wozniak, Complex Intell. Syst. 7(2021) 1895-1917. doi: 10.1007/s40747-020-00161-4
39. [39]
  M. Mueller, N. Smith, B. Ghanem, Context-aware correlation filter tracking, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 1387-1395.
40. [40]
  B. Lin, J. Xu, K. Lin, M. Li, M. Lu, ACS Sens. 3(2018) 2541-2549. doi: 10.1021/acssensors.8b00781
41. [41]
  E. Polshin, B. Verbruggen, D. Witters, et al., Sens. Actuators B: Chem. 196(2014) 175-182. doi: 10.1016/j.snb.2014.01.105
42. [42]
  S. Han, Q. Zhang, X. Zhang, et al., Biosens. Bioelectron. 143(2019) 111597. doi: 10.1016/j.bios.2019.111597
43. [43]
  M.H. Shamsi, K. Choi, A.H.C. Ng, M.D. Chamberlain, A.R. Wheeler, Biosens. Bioelectron. 77(2016) 845-852. doi: 10.1016/j.bios.2015.10.036
44. [44]
  Y. Zheng, Z. Wu, J.M. Lin, L. Lin, Chin. Chem. Lett. 31(2020) 451-454. doi: 10.1016/j.cclet.2019.07.036
45. [45]
  Y. Zheng, Z. Wu, M. Khan, et al., Anal. Chem. 91(2019) 12283-12289. doi: 10.1021/acs.analchem.9b02434
46. [46]
  Z. Wu, Y. Zheng, L. Lin, et al., Angew. Chem. Int. Ed. 59(2020) 2225-2229. doi: 10.1002/anie.201911252
1. [1]
  Yi Zhang , Biao Wang , Chao Hu , Muhammad Humayun , Yaping Huang , Yulin Cao , Mosaad Negem , Yigang Ding , Chundong Wang . Fe–Ni–F electrocatalyst for enhancing reaction kinetics of water oxidation. Chinese Journal of Structural Chemistry, 2024, 43(2): 100243-100243. doi: 10.1016/j.cjsc.2024.100243
2. [2]
  Yi Herng Chan , Zhe Phak Chan , Serene Sow Mun Lock , Chung Loong Yiin , Shin Ying Foong , Mee Kee Wong , Muhammad Anwar Ishak , Ven Chian Quek , Shengbo Ge , Su Shiung Lam . Thermal pyrolysis conversion of methane to hydrogen (H₂): A review on process parameters, reaction kinetics and techno-economic analysis. Chinese Chemical Letters, 2024, 35(8): 109329-. doi: 10.1016/j.cclet.2023.109329
3. [3]
  Huan Yao , Jian Qin , Yan-Fang Wang , Song-Meng Wang , Liu-Huan Yi , Shi-Yao Li , Fangfang Du , Liu-Pan Yang , Li-Li Wang . Ultra-highly selective recognition of nucleosides over nucleotides by rational modification of tetralactam macrocycle and its application in enzyme assay. Chinese Chemical Letters, 2024, 35(6): 109154-. doi: 10.1016/j.cclet.2023.109154
4. [4]
  Xinyi Luo , Ke Wang , Yingying Xue , Xiaobao Cao , Jianhua Zhou , Jiasi Wang . Digital PCR-free technologies for absolute quantitation of nucleic acids at single-molecule level. Chinese Chemical Letters, 2025, 36(2): 109924-. doi: 10.1016/j.cclet.2024.109924
5. [5]
  Zixing Xu , Ruiying Chen , Chuanming Hao , Qionghong Xie , Chunhui Deng , Nianrong Sun . Peptidome data-driven comprehensive individualized monitoring of membranous nephropathy with machine learning. Chinese Chemical Letters, 2024, 35(5): 108975-. doi: 10.1016/j.cclet.2023.108975
6. [6]
  Yiwen Lin , Yijie Chen , Chunhui Deng , Nianrong Sun . Integration of resol/block-copolymer carbonization and machine learning: A convenient approach for precise monitoring of glycan-associated disorders. Chinese Chemical Letters, 2024, 35(12): 109813-. doi: 10.1016/j.cclet.2024.109813
7. [7]
  Guorong Li , Yijing Wu , Chao Zhong , Yixin Yang , Zian Lin . Predesigned covalent organic framework with sulfur coordination: Anchoring Au nanoparticles for sensitive colorimetric detection of Hg(Ⅱ). Chinese Chemical Letters, 2024, 35(5): 108904-. doi: 10.1016/j.cclet.2023.108904
8. [8]
  Jia Chen , Yun Liu , Zerong Long , Yan Li , Hongdeng Qiu . Colorimetric detection of α-glucosidase activity using Ni-CeO₂ nanorods and its application to potential natural inhibitor screening. Chinese Chemical Letters, 2024, 35(9): 109463-. doi: 10.1016/j.cclet.2023.109463
9. [9]
  Caixia Zhu , Qing Hong , Kaiyuan Wang , Yanfei Shen , Songqin Liu , Yuanjian Zhang . Single nanozyme-based colorimetric biosensor for dopamine with enhanced selectivity via reactivity of oxidation intermediates. Chinese Chemical Letters, 2024, 35(10): 109560-. doi: 10.1016/j.cclet.2024.109560
10. [10]
  Yao-Hua Gu , Yu Chen , Qing Li , Neng-Bin Xie , Xue Xing , Jun Xiong , Min Hu , Tian-Zhou Li , Ke-Yu Yuan , Yu Liu , Tang Tang , Fan He , Bi-Feng Yuan . Metabolome profiling by widely-targeted metabolomics and biomarker panel selection using machine-learning for patients in different stages of chronic kidney disease. Chinese Chemical Letters, 2024, 35(11): 109627-. doi: 10.1016/j.cclet.2024.109627
11. [11]
  Fanghua Zhang , Yuyan Li , Hongyan Zhang , Wendong Liu , Zhe Hao , Mingzheng Shao , Ruizhong Zhang , Xiyan Li , Libing Zhang . Logically integrating exo/endogenous gated DNA trackers for precise microRNA imaging via synergistic manipulation. Chinese Chemical Letters, 2025, 36(1): 109848-. doi: 10.1016/j.cclet.2024.109848
12. [12]
  Pei Huang , Weijie Zhang , Junping Wang , Fangjun Huo , Caixia Yin . Rapid and specific fluorescent probe visualizes dynamic correlation of Cys and HClO in OGD/R. Chinese Chemical Letters, 2025, 36(1): 109778-. doi: 10.1016/j.cclet.2024.109778
13. [13]
  Yuxin Wang , Zhengxuan Song , Yutao Liu , Yang Chen , Jinping Li , Libo Li , Jia Yao . Methyl functionalization of trimesic acid in copper-based metal-organic framework for ammonia colorimetric sensing at high relative humidity. Chinese Chemical Letters, 2024, 35(6): 108779-. doi: 10.1016/j.cclet.2023.108779
14. [14]
  Ruonan Yang , Jiajia Li , Dongmei Zhang , Xiuqi Zhang , Xia Li , Han Yu , Zhanhu Guo , Chuanxin Hou , Gang Lian , Feng Dang . Grain-refining Co_0.85Se@CNT cathode catalyst with promoted Li₂O₂ growth kinetics for lithium-oxygen batteries. Chinese Chemical Letters, 2024, 35(12): 109595-. doi: 10.1016/j.cclet.2024.109595
15. [15]
  Gengchen Guo , Tianyu Zhao , Ruichang Sun , Mingzhe Song , Hongyu Liu , Sen Wang , Jingwen Li , Jingbin Zeng . Au-Fe₃O₄ dumbbell-like nanoparticles based lateral flow immunoassay for colorimetric and photothermal dual-mode detection of SARS-CoV-2 spike protein. Chinese Chemical Letters, 2024, 35(6): 109198-. doi: 10.1016/j.cclet.2023.109198
16. [16]
  Rui Wang , Yang Liang , Julius Rebek Jr. , Yang Yu . Stabilization and detection of labile reaction intermediates in supramolecular containers. Chinese Chemical Letters, 2024, 35(6): 109228-. doi: 10.1016/j.cclet.2023.109228
17. [17]
  Xin Li , Zhen Xu , Donglei Bu , Jinming Cai , Huamei Chen , Qi Chen , Ting Chen , Fang Cheng , Lifeng Chi , Wenjie Dong , Zhenchao Dong , Shixuan Du , Qitang Fan , Xing Fan , Qiang Fu , Song Gao , Jing Guo , Weijun Guo , Yang He , Shimin Hou , Ying Jiang , Huihui Kong , Baojun Li , Dengyuan Li , Jie Li , Qing Li , Ruoning Li , Shuying Li , Yuxuan Lin , Mengxi Liu , Peinian Liu , Yanyan Liu , Jingtao Lü , Chuanxu Ma , Haoyang Pan , JinLiang Pan , Minghu Pan , Xiaohui Qiu , Ziyong Shen , Shijing Tan , Bing Wang , Dong Wang , Li Wang , Lili Wang , Tao Wang , Xiang Wang , Xingyue Wang , Xueyan Wang , Yansong Wang , Yu Wang , Kai Wu , Wei Xu , Na Xue , Linghao Yan , Fan Yang , Zhiyong Yang , Chi Zhang , Xue Zhang , Yang Zhang , Yao Zhang , Xiong Zhou , Junfa Zhu , Yajie Zhang , Feixue Gao , Yongfeng Wang . Recent progress on surface chemistry Ⅰ: Assembly and reaction. Chinese Chemical Letters, 2024, 35(12): 110055-. doi: 10.1016/j.cclet.2024.110055
18. [18]
  Xianxu Chu , Lu Wang , Junru Li , Hui Xu . Surface chemical microenvironment engineering of catalysts by organic molecules for boosting electrocatalytic reaction. Chinese Chemical Letters, 2024, 35(8): 109105-. doi: 10.1016/j.cclet.2023.109105
19. [19]
  Kebo Xie , Qian Zhang , Fei Ye , Jungui Dai . A multi-enzymatic cascade reaction for the synthesis of bioactive C-oligosaccharides. Chinese Chemical Letters, 2024, 35(6): 109028-. doi: 10.1016/j.cclet.2023.109028
20. [20]
  Zhao Li , Huimin Yang , Wenjing Cheng , Lin Tian . Recent progress of in situ/operando characterization techniques for electrocatalytic energy conversion reaction. Chinese Chemical Letters, 2024, 35(9): 109237-. doi: 10.1016/j.cclet.2023.109237

Get Citation

PDF

XML

Metrics

PDF Downloads(3)
Abstract views(537)
HTML views(41)

通讯作者: 陈斌, bchen63@163.com

1.
沈阳化工大学材料科学与工程学院沈阳 110142