Skip to main content

Heng Fan

Title: Assistant Professor

Department: Computer Science and Engineering

College: College of Engineering

Curriculum Vitae

Curriculum Vitae Link

Education

  • PhD, Stony Brook University, 2021
    Major: Computer Science
    Dissertation: Algorithms and Benchmarks for Robust Visual Object Tracking

Current Scheduled Teaching

CSCE 6260.001Advanced Topics in Pattern Recognition and Image ProcessingSpring 2026
CSCE 5218.002Deep LearningSpring 2026
CSCE 6950.905Doctoral DissertationSpring 2026
Texas Education Code 51.974 (HB 2504) requires each institution of higher education to make available to the public, a syllabus for undergraduate lecture courses offered for credit by the institution.

Previous Scheduled Teaching

CSCE 6950.805Doctoral DissertationFall 2025
CSCE 2110.002Foundations of Data StructuresFall 2025 Syllabus SPOT
CSCE 2110.211Foundations of Data StructuresFall 2025 Syllabus SPOT
CSCE 2110.213Foundations of Data StructuresFall 2025 Syllabus SPOT
CSCE 2110.215Foundations of Data StructuresFall 2025 Syllabus SPOT
CSCE 6940.805Individual ResearchFall 2025
CSCE 6940.805Individual ResearchSummer 10W 2025
CSCE 5218.004Deep LearningSpring 2025 SPOT
CSCE 6950.905Doctoral DissertationSpring 2025
CSCE 6940.905Individual ResearchSpring 2025
CSCE 2900.705Special Problems in Computer Science and EngineeringSpring 2025
CSCE 6280.002Advanced Topics in Artificial IntelligenceFall 2024 SPOT
CSCE 5934.805Directed StudyFall 2024
CSCE 6950.805Doctoral DissertationFall 2024
CSCE 6940.805Individual ResearchFall 2024
CSCE 2900.705Special Problems in Computer Science and EngineeringFall 2024
CSCE 5934.805Directed StudySummer 10W 2024
CSCE 5218.004Deep LearningSpring 2024 SPOT
CSCE 6950.905Doctoral DissertationSpring 2024
CSCE 6940.905Individual ResearchSpring 2024
CSCE 5900.805Special ProblemsSpring 2024
CSCE 6280.002Advanced Topics in Artificial IntelligenceFall 2023 SPOT
CSCE 6950.805Doctoral DissertationFall 2023
CSCE 6940.805Individual ResearchFall 2023
CSCE 5934.805Directed StudySummer 10W 2023
CSCE 5218.004Deep LearningSpring 2023 Syllabus SPOT
CSCE 6950.905Doctoral DissertationSpring 2023
CSCE 6940.920Individual ResearchSpring 2023
CSCE 5900.820Special ProblemsSpring 2023
CSCE 3110.001Data Structures and AlgorithmsFall 2022 Syllabus SPOT
CSCE 6940.805Individual ResearchFall 2022
CSCE 5900.805Special ProblemsFall 2022
CSCE 5218.001Deep LearningSpring 2022 Syllabus SPOT
CSCE 6940.920Individual ResearchSpring 2022
CSCE 3110.001Data Structures and AlgorithmsFall 2021 Syllabus SPOT
Texas Education Code 51.974 (HB 2504) requires each institution of higher education to make available to the public, a syllabus for undergraduate lecture courses offered for credit by the institution.

Published Intellectual Contributions

    Conference Proceeding

  • Liu, Y., Liang, J., Fan, H., Yang, W., Cui, Y., Han, X., Huang, L., Liu, D., Wang, Q., Han, C. (2025). All You Need is One: Capsule Prompt Tuning with a Single Vector. Advances in Neural Information Processing Systems (NeurIPS).
  • Li, Y., Jiao, Y., Meng, D., Fan, H., Zhang, L. (2025). Attention to Trajectory: Trajectory-Aware Open-Vocabulary Tracking. IEEE/CVF International Conference on Computer Vision (ICCV).
  • Li, W., Liu, X., Fan, H., Zhang, L. (2025). CGTrack: Cascade Gating Network with Hierarchical Feature Aggregation for UAV Tracking. IEEE International Conference on Robotics and Automation (ICRA).
  • Xue, Z., Guo, M., Fan, H., Zhang, S., Zhang, Z. (2025). CorrBEV: Multi-View 3D Object Detection by Correlation Learning with Multi-modal Prototypes. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR),
  • Guo, Y., Song, B., Fan, H., Cheng, E. (2025). Edge-Aware Token Halting for Efficient and Accurate Medical Image Segmentation. International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI).
  • Dong, S., Feng, Y., Liang, J., Yang, Q., Lin, Y., Fan, H. (2025). Efficient and Accurate Low-Resolution Transformer Tracking. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Ren, H., Luo, Z., Fan, H., Yuan, X., Wang, G., Zhang, L. (2025). G3CN: Gaussian Topology Refinement Gated Graph Convolutional Network for Skeleton-Based Action Recognition. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Jiao, Y., Li, Y., Ding, J., Yang, Q., Fu, S., Fan, H., Zhang, L. (2025). GSOT3D: Towards Generic 3D Single Object Tracking in the Wild. IEEE/CVF International Conference on Computer Vision (ICCV).
  • Gu, X., Shen, Y., Luo, C., Luo, T., Huang, Y., Lin, Y., Fan, H., Zhang, L. (2025). Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding. International Conference on Learning Representations (ICLR).
  • Li, Y., Liu, X., Liu, L., Fan, H., Zhang, L. (2025). LaMOT: Language-Guided Multi-Object Tracking. IEEE International Conference on Robotics and Automation (ICRA).
  • Lin, L., Fan, H., Zhang, Z., Huang, Y., Wang, Y., Xu, Y., Ling, H. (2025). LoRATv2: Enabling Low-Cost Temporal Modeling in One-Stream Trackers. Advances in Neural Information Processing Systems (NeurIPS).
  • Fan, B., Feng, Y., Tian, Y., Liang, J.C., Huang, Y., Lin, Y., Fan, H. (2025). PRVQL: Progressive Knowledge-guided Refinement for Robust Egocentric Visual Query Localization. IEEE/CVF International Conference on Computer Vision (ICCV).
  • Hu, Y., Fan, B., Gu, X., Ren, H., Liu, D., Fan, H., Zhang, L. (2025). Robust Ego-Exo Correspondence with Long-Term Memory. Advances in Neural Information Processing Systems (NeurIPS).
  • Zhang, Z., Li, Z., Wang, H., Yuan, H., Wang, K., Fan, H. (2025). The Devil Is in the Quality: Exploring Informative Samples for Semi-Supervised Monocular 3D Object Detection. IEEE International Conference on Robotics and Automation (ICRA).
  • Liu, X., Feng, Y., Hu, S., Yuan, X., Fan, H. (2024). Benchmarking the Robustness of UAV Tracking Against Common Corruptions. 2024 IEEE 7th IEEE International Conference on Multimedia Information Processing and Retrieval.
  • Li, Y., Li, Q., Wang, H., Ma, X., Yao, J., Dong, S., Fan, H., Zhang, L. (2024). Beyond MOT: Semantic Multi-object Tracking. European Conference on Computer Vision (ECCV).
  • Gu, X., Fan, H., Huang, Y., Luo, T., Zhang, L. (2024). Context-Guided Spatio-Temporal Video Grounding. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Dong, S., Feng, Y., Yang, Q., Huang, Y., Liu, D., Fan, H. (2024). Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Dong, S., Feng, Y., Yang, Q., Huang, Y., Liu, D., Fan, H. (2024). Efficient multimodal semantic segmentation via dual-prompt learning. 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 14196--14203.
  • Zheng, J., Fan, H., Zhang, L. (2024). Kernel Adaptive Convolution for Scene Text Detection via Distance Map Prediction. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Lu, Y., Liu, D., Wang, Q., Han, C., Cui, Y., Cao, Z., Zhang, X., Chen, Y., Fan, H. (2024). ProMotion: Prototypes As Motion Learners. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
  • Mitayeegiri, J., Dong, S., Qiu, C., Yang, Q., Li, X., Fan, H., Huang, Y. (2024). Radio Map Estimation (RME) with Deep Progressive Network. 2024 IEEE 7th International Conference on Multimedia Information Processing and Retrieval (MIPR).
  • Shaik, K., Wang, D., Zheng, W., Cao, Q., Fan, H., Schwartz, P., Feng, Y. (2024). S3LLM: Large-S cale S cientific S oftware Understanding with LLMs Using Source, Metadata, and Document. International Conference on Computational Science. 222--230.
  • Qu, D., Chen, Q., Bai, T., Lu, H., Fan, H., Zhang, H., Fu, S., Yang, Q. (2024). SiCP: Simultaneous Individual and Cooperative Perception for 3D Object Detection in Connected and Automated Vehicles. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Qu, D., Chen, Q., Bai, T., Lu, H., Fan, H., Zhang, H., Fu, S., Yang, Q. (2024). SiCP: Simultaneous Individual and Cooperative Perception for 3D Object Detection in Connected and Automated Vehicles. 2024 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). 8905--8912.
  • Lin, L., Fan, H., Zhang, Z., Wang, Y., Xu, Y., Ling, H. (2024). Tracking Meets LoRA: Faster Training, Larger Model, Stronger Performance. European Conference on Computer Vision (ECCV).
  • Peng, L., Gao, J., Liu, X., Li, W., Dong, S., Zhang, Z., Fan, H., Zhang, L. (2024). VastTrack: Vast Category Visual Object Tracking. Thirty-Eighth Annual Conference on Neural Information Processing Systems (NeurIPS).
  • Wang, H., Yu, Y., Luo, T., Fan, H., Zhang, L. (2024). MaGIC: Multi-modality Guided Image Completion. International Conference on Learning Representations (ICLR).
  • Arbaz, A., Fan, H., Ding, J., Qiu, M., Feng, Y. (2024). GenFlowchart: Parsing and Understanding Flowchart Using Generative AI. The 17th International Conference on Knowledge Science, Engineering and Management (KSEM 2024).
  • Yadav, S., Le, T., Dong, S., Fan, H., Yang, Q., Qiu, C., Huang, Y. (2024). A New Simulation Platform For Learning-Empowered Distributed Sensing. SPIE Defense + Commercial Sensing 2024.
  • Feng, Y., Meng, Z., Clemmer, C., Fan, H., Huang, Y. (2023). A Multi-granularity Decade-Long Geo-Tagged Twitter Dataset for Spatial Computing. ACM International Conference on Advances in Geographic Information Systems (SIGSPATIAL).
  • Shen, Y., Gu, X., Xu, K., Fan, H., Wen, L., Zhang, L. (2023). Accurate and Fast Compressed Video Captioning. International Conference on Computer Vision (ICCV).
  • Feng, Y., Meng, Z., Clemmer, C., Fan, H., Huang, Y. (2023). Data and Resources Paper: A Multi-granularity Decade-Long Geo-Tagged Twitter Dataset for Spatial Computing. Proceedings of the 31st ACM International Conference on Advances in Geographic Information Systems. 1--4.
  • Liu, X., Liu, X., Yi, Z., Zhou, X., Le, T., Zhang, L., Huang, Y., Yang, Q., Fan, H. (2023). PlanarTrack: A Large-scale Challenging Benchmark for Planar Object Tracking. International Conference on Computer Vision (ICCV).
  • Liu, X., Lin, Y., Yang, Q., Fan, H. (2023). Transferable Adversarial Attack on 3D Object Tracking in Point Cloud. International Conference on Multimedia Modeling (MMM).
  • Gu, B., Fan, H., Zhang, L. (2023). Two Birds, One Stone: A Unified Framework for Joint Learning of Image and Video Style Transfers. International Conference on Computer Vision (ICCV).
  • Zhou, W., Fan, H., Luo, T., Zhang, L. (2023). Unsupervised Domain Adaptive Detection with Network Stability Analysis. International Conference on Computer Vision (ICCV).
  • Yi, Z., Blanco, E., Fan, H., Albert, M. (2022). BAPO: A Large-Scale Multimodal Corpus for Ball Possession Prediction in American Football Games. IEEE Conference on Multimedia Information Processing and Retrieval (MIPR).
  • Guo, M., Zhang, Z., Fan, H., Jing, L. (2022). Divert More Attention to Vision-Language Tracking. Thirty-Sixth Annual Conference on Neural Information Processing Systems (NeurIPS).
  • Yu, Y., Zhang, L., Fan, H., Luo, T. (2022). High-Fidelity Image Inpainting with GAN Inversion. European Conference on Computer Vision (ECCV).
  • Guo, M., Zhang, Z., Fan, H., Jing, L., Lyu, Y., Li, B., Hu, W. (2022). Learning Target-aware Representation for Visual Tracking via Informative Interactions. International Joint Conference on Artificial Intelligence (IJCAI).
  • Lin, L., Fan, H., Zhang, Z., Xu, Y., Ling, H. (2022). SwinTrack: A Simple and Strong Baseline for Transformer Tracking. Thirty-Sixth Annual Conference on Neural Information Processing Systems (NeurIPS).
  • Fan, H., Ling, H. (2021). CRACT: Cascaded Regression-Align-Classification for Robust Tracking. 7013-7020. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).
  • Fan, H., Ling, H. (2021). MART: Motion-Aware Recurrent Neural Network for Robust Visual Tracking. 566-575. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).
  • Singh, Y., Atulkar, V., Ren, J., Yang, J., Fan, H., Latecki, L., Ling, H. (2021). Osteoporosis Prescreening and Bone Mineral Density Prediction using Dental Panoramic Radiographs. 2700-2703. IEEE Engineering in Medicine & Biology Society (EMBC).
  • Fan, H., Yang, F., Chu, P., Lin, Y., Yuan, L., Ling, H. (2021). TracKlinic: Diagnosis of Challenge Factors in Visual Tracking. 970-979. IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).
  • Fan, H., Miththanthaya, H., Rajan, S., Liu, X., Zou, Z., Lin, Y., Ling, H. (2021). Transparent Object Tracking Benchmark. 10734-10743. IEEE/CVF International Conference on Computer Vision (ICCV).

    • Journal Article

  • Li, Y., Xiao, Z., Yang, L., Meng, D., Zhou, X., Fan, H., Zhang, L. (2025). AttMOT: Improving Multiple-Object Tracking by Introducing Auxiliary Pedestrian Attributes. 36 (3) 5454-5468. IEEE Transactions on Neural Networks and Learning Systems.
  • Zhang, L., Yu, Y., Yao, J., Fan, H. (2025). High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion. International Journal of Computer Vision. 133 5788–5805.
  • Jiao, Y., Liu, X., Liu, X., Yuan, X., Fan, H., Zhang, L. (2025). PlanarTrack: A High-quality and Challenging Benchmark for Large-scale Planar Object Tracking. 262 (104553) Computer Vision and Image Understanding.
  • Liu, X., Feng, Y., Hu, S., Yuan, X., Fan, H. (2024). Benchmarking the Robustness of UAV Tracking Against Common Corruptions. Other.
  • Guo, M., Zhang, Z., Jing, L., He, Y., Wang, K., Fan, H. (2024). Cyclic Refiner: Object-Aware Temporal Representation Learning for Multi-view 3D Detection and Tracking. International Journal of Computer Vision. 132 6184-6206.
  • Guo, M., Zhang, Z., Jing, L., Ling, H., Fan, H. (2024). Divert More Attention to Vision-Language Object Tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence. 46 (12) 8600-8618.
  • Zuo, X., Qi, C., Chen, Y., Shen, J., Fan, H., Yang, W. (2024). Learnable Cross-Scale Sparse Attention Guided Feature Fusion for UAV Object Detection. IEEE Access. 12 114212-114226.
  • Dong, S., Feng, Y., Yang, Q., Lin, Y., Fan, H. (2024). LoReTrack: Efficient and Accurate Low-Resolution Transformer Tracking. Other.
  • Lu, Y., Han, C., Wang, Q., Fan, H., Kong, Z., Liu, D., Chen, Y. (2024). Optical Flow as Spatial-Temporal Attention Learners. IEEE Transactions on Pattern Analysis and Machine Intelligence. 46 (12) 11491 - 11506.
  • Zhang, L., Zhou, W., Fan, H., Luo, T., Ling, H. (2024). Robust Domain Adaptive Object Detection With Unified Multi-Granularity Alignment. IEEE Transactions on Pattern Analysis and Machine Intelligence. 46 (12) 9161 - 9178.
  • Jahan, R.I., Fan, H., Chen, H., Feng, Y. (2024). Unlocking Cross-Lingual Sentiment Analysis through Emoji Interpretation: A Multimodal Generative AI Approach. Other.
  • Shen, J., Chen, Y., Liu, Y., Zuo, X., Fan, H., Yang, W. (2024). ICAFusion: Iterative Cross-Attention Guided Feature Fusion for Multispectral Object Detection. Pattern Recognition. 145 109913.
  • Zhang, L., Gu, X., Li, C., Luo, T., Fan, H. (2024). Local Compressed Video Stream Learning for Generic Event Boundary Detection. International Journal of Computer Vision. 132 1187–1204.
  • Shen, J., Guo, T., Zuo, X., Fan, H., Yang, W. (2024). SSPNet: Scale and Spatial Priors Guided Generalizable and Interpretable Pedestrian Attribute Recognition. Pattern Recognition. 148 110194.
  • Zhang, L., Jiang, L., Ji, R., Fan, H. (2023). PIDray: A Large-scale X-ray Benchmark for Real-World Prohibited Item Detection. International Journal of Computer Vision. 131 3170–3192.
  • Zhang, L., Gao, J., Xiao, Z., Fan, H. (2023). AnimalTrack: A Benchmark for Multi-Animal Tracking in the Wild. International Journal of Computer Vision. 131 496–513.
  • Wang, H., Zhang, L., Fan, H., Luo, T. (2023). Collaborative three-stream transformers for video captioning. 235 103799. Computer Vision and Image Understanding.
  • Liu, Y., Fan, H., Yuan, X., Xiang, J. (2022). GL-GAN: Adaptive Global and Local Bilevel Optimization for Generative Adversarial Network. Pattern Recognition. 123 108375--1.
  • Zhou, Q., Wang, R., Zeng, G., Fan, H., Zheng, G. (2022). Towards bridging the distribution gap: Instance to Prototype Earth Mover’s Distance for distribution alignment. 82 102607. Medical Image Analysis.
  • Zhu, P., Wen, L., Du, D., Bian, X., Fan, H., Hu, Q., Ling, H. (2022). Detection and Tracking Meet Drones Challenge. IEEE Transactions on Pattern Analysis and Machine Intelligence. 44 (11) 7380-7399.
  • Liu, Y., Fan, H., Ni, F., Xiang, J. (2021). ClsGAN: Selective Attribute Editing Model based on Classification Adversarial Network. Neural Networks. 133 220-228.
  • Fan, H., Bai, H., Lin, L., Yang, F., Chu, P., Deng, G., Yu, S., , H., Huang, M., Liu, J., Xu, Y., Liao, C., Yuan, L., Ling, H. (2021). LaSOT: A High-quality Large-scale Single Object Tracking Benchmark. International Journal of Computer Vision. 129 439–461.
  • Jia, J., Elezovikj, S., Fan, H., Yang, S., Liu, J., Guo, W., Tan, C., Ling, H. (2021). Semantic-Aware Label Placement for Augmented Reality in Street View. The Visual Computer. 37 1805-1819.

Contracts, Grants and Sponsored Research

    Grant - Research

  • Huang, Y. (Principal), Li, X. (Co-Principal), Yang, Q. (Co-Principal), Fan, H. (Co-Principal), Qiu, C. (Co-Principal), Wei, Y. (Co-Principal), Baba, A.I. (Supporting), "Intelligent Distributed Sensing," sponsored by Army Research Lab/Northeastern University, Federal, $902266 Funded. (2024 - 2025).
  • Fan, H. (Principal), "Cooperative Perception for Connected Vehicles," sponsored by Toyota Motor Engineering & Manufacturing North America, International, $60000 Funded. (2023 - 2024).
  • Huang, Y. (Principal), Li, X. (Co-Principal), Yang, Q. (Co-Principal), Fan, H. (Co-Principal), Qiu, C. (Co-Principal), Wei, Y. (Co-Principal), Baba, A.I. (Supporting), "Learning Empowered Distributed Sensing," sponsored by Army Research Lab/Northeastern University, Federal, $2069324 Funded. (2023 - 2024).
,
Overall
Summative Rating		 Challenge and
Engagement Index		 Response Rate

out of 5
out of 7		 %
of
students responded
  • Overall Summative Rating (median):
    This rating represents the combined responses of students to the four global summative items and is presented to provide an overall index of the class’s quality. Overall summative statements include the following (response options include a Likert scale ranging from 5 = Excellent, 3 = Good, and 1= Very poor):
    • The course as a whole was
    • The course content was
    • The instructor’s contribution to the course was
    • The instructor’s effectiveness in teaching the subject matter was
  • Challenge and Engagement Index:
    This rating combines student responses to several SPOT items relating to how academically challenging students found the course to be and how engaged they were. Challenge and Engagement Index items include the following (response options include a Likert scale ranging from 7 = Much higher, 4 = Average, and 1 = Much lower):
    • Do you expect your grade in this course to be
    • The intellectual challenge presented was
    • The amount of effort you put into this course was
    • The amount of effort to succeed in this course was
    • Your involvement in course (doing assignments, attending classes, etc.) was
CLOSE