Research

Computational imaging and structured visual perception for optical inspection, agricultural remote sensing, and automated measurement.

Research funding

NSFC Young Scientists Fund (Category C) · Principal Investigator

Imaging Degradation Mechanisms and Visual Perception Enhancement for Early-Stage Weed Identification in Paddy Fields

水稻田苗期杂草识别成像退化机理与视觉感知增强研究

Project 32602720 · 2027–2029 · Awarded, starts in 2027.

Current research

15. Multi-focus defect perception in optical components

Ongoing research

Industry context · Sunny Optical 舜宇光学

A 25-layer focus stack captures how the same lens region changes with focus. Cross-layer analysis compares response strength and trajectory shape against normal optical-structure evolution, aiming to distinguish defect-related deviations from persistent background patterns.

Polar–Fourier modeling establishes an interpretable reference for normal optical structure. The ongoing extension across focus aims to resolve ambiguities in single-layer inspection, distinguishing defect-related deviations from persistent background patterns and supporting reliable anomaly localization under limited annotation.

Concept illustration of a lens and 25-layer focus stack. Matched defect and normal-region markers connect to illustrative response trajectories; both persist across focus but differ in strength and shape.
Concept illustration · 25-layer input and illustrative focus-response trajectories. View full image

14. Multimodal optical localization with Florence-2

Prototype · ongoing evaluation

Image features and language tokens jointly enter Florence-2’s multimodal encoder–decoder, converting target descriptions into candidate image regions. This connects semantic prompts with spatial detections for lenses and sensors.

Geometric constraints refine semantic candidates into valid inspection regions; sensor localization uses an outer crop and a second inner-region prompt before mapping back to the original image. This links target recognition to physical component boundaries, aiming to reduce background interference and the reliance on component-specific localization rules.

Concept illustration of image and text tokens interacting inside Florence-2's encoder–decoder. Smartphone camera-module lens and sensor candidates lead to an overlaid circular lens ROI and a cropped sensor AOI.
Concept illustration · image–text token interaction, grounding, and optical ROI refinement. View full image

Previous research

13. Grade2Seg · weakly supervised weed segmentation from severity grades

Research project · revision recorded in 2025

Image-level weed severity grades provide supervision for spatial segmentation. A Sqrt-Error-Weighted ordinal objective learns severity-dependent responses; class activation maps are converted into pseudo-masks for segmentation training.

The workflow produces broadleaf and grass-weed masks from grade annotations, reducing reliance on manually drawn pixel labels. Generalization across field conditions remains an evaluation focus.

Grade2Seg research diagram connecting weed severity classification, activation maps, pseudo-masks, and segmentation.
Research workflow · from image-level supervision to spatial predictions. View full image

12. CropSR / EVADM

Published · ISPRS JPRS 2024

Image variance decreases with increasing flight altitude, providing a scale-sensitive cue for aerial-image restoration. Variance-Average-Spatial Attention (VASA) incorporates this cue into the iterative reconstruction of the EVADM diffusion model.

On the published real-image benchmarks, SRFI improved by 27% at ×2 and 6% at ×4 relative to the baselines. Cross-dataset and downstream evaluations support restoration of fine crop structure for agricultural perception.

Original CropSR comparison figure showing a crop-field sample at high resolution, low resolution, and after super-resolution.
Original research figure · HR / LR / SR, top to bottom. View full image

11. UAV mapping of lake algal blooms

Research project · 2023

Cascaded waterbody and algal-bloom segmentation separates affected water regions from shoreline and terrestrial backgrounds. Direct geo-location maps image detections into geographic coordinates.

The output is a spatial distribution map of algal-bloom regions, supporting rapid lake surveys and targeted follow-up inspection.

Original aerial lake map with spatial algal-bloom detections overlaid along the shoreline and surrounding water.
Original project visualization · algal-bloom mapping. View full image

10. PaddySeg · rice-field segmentation and phenology recognition

Published · Drones 2023

Ghost Bilateral Network (GBiNet) combines efficient ghost-convolution features with bilateral segmentation to identify rice regions and four phenological stages in UAV images.

GBiNet_r2 achieved 91.50% test mIoU on PaddySeg, compared with 90.95% for BiSeNetV2, with lower computational cost. The resulting trait masks support field-scale phenology mapping.

Research diagram illustrating aerial field segmentation and direct geographic mapping of rice phenology.
Original research figure · segmentation and spatial mapping. View full image

9. Direct geo-location & incremental sparse sampling

Published · Drones 2023 · companion method to PaddySeg

Camera parameters and central projection map image pixels directly to ground coordinates. Incremental sparse sampling removes redundant observations from overlapping UAV images before trait-map interpolation.

The published evaluation reported a mean deviation of 21 cm across 20 ground-control points, below 1% of relative flight height. This provides a direct route from UAV image sequences to georeferenced crop-trait maps.

Original diagram of direct UAV image geo-location using camera projection and ground coordinates.
Original research figure · direct geo-location and trait sampling. View full image

8. GeT · grape leaf disease and pest diagnosis

Published · JKSU-CIS 2022

Ghost convolution extracts local symptom features with inexpensive linear operations; transformer self-attention adds global context for grape-leaf disease and pest classification against complex field backgrounds.

On GLDP12k, the ImageNet-initialized GeT model achieved 98.14% classification accuracy with 1.16 million parameters. The compact architecture supports efficient field-image diagnosis.

Original GeT model diagram showing the ghost-convolution backbone, transformer encoder, classification head, and grape-leaf activation maps.
Original research figure · model architecture and activation maps. View full image

7. Cascaded 24-channel weighing system

Engineering project · 2020

A cascaded I2C architecture links modular weighing nodes to a shared data-acquisition system. Low-power Arduino Pro Mini controllers and plug-in PCBs provide a scalable hardware interface.

The implemented prototype acquires weight measurements across 24 channels, providing a modular basis for parallel weighing experiments.

Original circuit and system diagram for the cascaded 24-channel weighing platform.
Original project figure · modular weighing and data acquisition. View full image

6. Vision-based citrus sizing

Engineering project · 2020

HSV segmentation isolates citrus fruit under controlled-background imaging. Bounding-box pixel dimensions are converted into diameter estimates using the camera imaging geometry.

The workflow provides per-fruit outlines and size estimates for automated measurement; the original calibration plot documents the pixel-to-diameter relationship.

Original citrus sizing image showing individual fruit with measured outlines and diameter annotations.
Original project image · fruit segmentation and diameter estimates. View full image

5. LIBS sensing of soil heavy metals

Undergraduate thesis · 2020

Laser-induced breakdown spectroscopy resolves soil-metal signatures from plasma emission spectra. Argon-assisted excitation and a light-convergence chamber are evaluated for signal enhancement, with spectral analysis identifying informative wavelength features.

The batch-testing platform design combines sample handling and optical acquisition for laboratory soil analysis. The linked slides and device patent document the spectroscopy and signal-collection approach.

Original LIBS figure showing principal-component loadings and spectral peaks against wavelength.
Original thesis figure · spectral features and signal analysis. View full image

4. Integrated seeding and fertilizing device

Engineering contest project · 2019

Coordinated motor and valve control combines seed metering with liquid-fertilizer application in one mechanism.

The assembled prototype synchronizes seed delivery and spraying, demonstrating integrated electrical control of two field operations.

Original photographs and structural illustration of the integrated seeding and fertilizing prototype.
Original project figure · seeding, liquid delivery, and control. View full image

3. Reciprocating mechanism using a curved-groove ball bearing

Mechanical design · 2019

A curved-groove bearing mechanism converts rotary input into reciprocating linear motion through constrained rolling contact.

The mechanical design and motion animation demonstrate an alternative rotary-to-linear transmission concept for reciprocating machinery.

Original mechanism animation · rotary input and reciprocating motion. View still frame

2. Weed identification from UAV imagery

Undergraduate research project · 2018

A labeled UAV-image dataset covers five weed types in seedling-stage wheat fields. Real-time convolutional models translate aerial observations into weed-category predictions.

The workflow connects aerial image acquisition, annotation, and recognition for field weed surveys. The poster and related UAV spraying-device patent preserve the original project materials.

Original UAV and field-image montage for weed identification in seedling-stage wheat fields.
Original project image · UAV observation and weed recognition. View full image

1. Electric-vehicle charging-station network planning

Mathematical modeling project · ICM 2018

Polynomial curve fitting represents electric-vehicle growth, while a multi-objective location model evaluates candidate charging-station configurations.

The MATLAB implementation produces spatial deployment scenarios for demand-oriented charging infrastructure planning.

Original spatial heat map from the electric-vehicle charging station location-planning study.
Original modeling figure · charging-network location planning. View full image