Metaheuristics for Mixture-of-Expert Architecture Search

Active collaboration ยท in progress, 2025

Metaheuristics for mixture-of-expert architecture search

Partnering with UW neuroscience researcher Ian Quah to investigate neuroscience-informed heuristics in the search for ultra energy-efficient and performant edge vision transformers, through data-dependent subnetwork computation.