DeepFocus: a deep learning model for focusing microscope systems

Tonislav Ivanov; Ayush Kumar; Denis Sharoukhov; Francis Ortega; Matthew Putman

doi:10.1117/12.2568990

20 August 2020 DeepFocus: a deep learning model for focusing microscope systems

Tonislav Ivanov, Ayush Kumar, Denis Sharoukhov, Francis Ortega, Matthew Putman

Proceedings Volume 11511, Applications of Machine Learning 2020; 1151103 (2020) https://doi.org/10.1117/12.2568990
Event: SPIE Optical Engineering + Applications, 2020, Online Only

Abstract

Conventional microscopy focusing methods perform a time consuming sweep through the Z-axis in order to estimate the focal plane. As an alternative, we developed a deep learning model that predicts in one shot the distance offset to the focal plane from any initial position using an input of only two images taken a set distance apart. The difference of these two images is processed through a regression CNN model, which was trained to learn a direct mapping between the amount of defocus aberration and the distance from the focal plane. A training dataset was acquired from a semiconductor sample at different surface locations on the sample and at different distances from focus. The ground truth focal plane was determined using a parabolic autofocus algorithm with the Tenengrad scoring metric. The CNN model was tested on bare semiconductor sample using the projected shape of the F-stop. The model was able to determine the in-focus position with high reliability, and was also significantly faster than conventional methods that rely on classical computer vision. Furthermore, the rare cases where our algorithm does not find the focal plane can be detected, and a fine-focus algorithm can be applied to correct the result. With the collection of sufficient training data, our deep learning focusing model provides a significantly faster alternative to conventional focusing methods.

Conference Presentation

Citation Download Citation

Tonislav Ivanov, Ayush Kumar, Denis Sharoukhov, Francis Ortega, and Matthew Putman "DeepFocus: a deep learning model for focusing microscope systems", Proc. SPIE 11511, Applications of Machine Learning 2020, 1151103 (20 August 2020); https://doi.org/10.1117/12.2568990

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available