Network architecture search of X-ray based scientific applications
Adarsha Balaji Ramyad Hadidi Gregory Kollmer Mohammed E. Fouda Prasanna Balaprakash
X-ray and electron diffraction-based microscopy use bragg peak detection and
ptychography to perform 3-D imaging at an atomic resolution. Typically, these
techniques are implemented using computationally complex tasks such as a
Psuedo-Voigt function or solving a complex inverse problem. Recently, the use
of deep neural networks has improved the existing state-of-the-art approaches.
However, the design and development of the neural network models depends on
time and labor intensive tuning of the model by application experts. To that
end, we propose a hyperparameter (HPS) and neural architecture search (NAS)
approach to automate the design and optimization of the neural network models
for model size, energy consumption and throughput. We demonstrate the improved
performance of the auto-tuned models when compared to the manually tuned
BraggNN and PtychoNN benchmark. We study and demonstrate the importance of the
exploring the search space of tunable hyperparameters in enhancing the
performance of bragg peak detection and ptychographic reconstruction. Our NAS
and HPS of (1) BraggNN achieves a 31.03\% improvement in bragg peak detection
accuracy with a 87.57\% reduction in model size, and (2) PtychoNN achieves a
16.77\% improvement in model accuracy and a 12.82\% reduction in model size
when compared to the baseline PtychoNN model. When inferred on the Orin-AGX
platform, the optimized Braggnn and Ptychonn models demonstrate a 10.51\% and
9.47\% reduction in inference latency and a 44.18\% and 15.34\% reduction in
energy consumption when compared to their respective baselines, when inferred
in the Orin-AGX edge platform.