Guo, K.; Song, Z.; Zhou, J.; Shen, B.; Yan, B.; Gu, Z.; Wang, H.

Digital microfluidics (DMF) is a versatile technique for parallel and field-programmable control of individual droplets. Given the high freedom in droplet manipulation, it is essential to establish self-adaptive and intelligent control methods for DMF systems with informed of the transient state of droplets and their interactions. However, most related studies focus on the localization and shape recognition of droplets. Here, we develop an AI-assisted DMF framework named \"DropAI\" for multistate droplet control based on droplet morphology. Semantic segmentation model is integrated into our custom-designed DMF system to recognize the droplet states and their interactions for feedback control with a state machine. The proposed model has a strong generalization ability and can recognize droplets of different colors and shapes with an error rate of less than 0.63%. It enables control of droplets without user intervene. The proposed system will inspire the development of semantic-driven DMF systems which can interface with artificial general intelligence (AGl) models for fully automatic control.