๐Ÿš€ Projects

๐Ÿš€ Projects

An ounce of Action is worth a ton of Theory.

ResNet Sparse Distillation

The increasing depth and width of neural networks improve accuracy but also raise hardware requirements and slow down inference. This project proposes a distillation loss function that enables immediate weight and activation pruning on the student model after distillation.
Course Project CNN Efficient Pruning
ResNet Sparse Distillation

JEPA Architecture Probing Model

This project designed a JEPA architecture model with CNN and MLPs as encoder and predictor. The main task is to predict the trajectory of an object in an environment with wall and door.
Course Project World Model CNN
JEPA Architecture Probing Model