CommaVQ compression challenge
Details
Yuval Levental will present a project he submitted for a coding competition, where he placed third. It covers the commaVQ compression challenge from start to finish: the problem setup, why the obvious approach (using the provided GPT model) didn't work, and the architecture decisions that led to a 2.7x compression ratio with a 5.3M parameter transformer.
Additionally, the full pipeline will be discussed: frame prediction, quantization, and ANS entropy coding, with an emphasis on tradeoffs between model size and compression quality. Practical challenges like hardware reproducibility and potential improvements with more compute will also be addressed.
The project: https://github.com/ylevental/commavq-compression
The leader board: https://comma.ai/leaderboard#compression_challenge
Location Information:
Zoom
https://us02web.zoom.us/j/84930907382?pwd=eFk0a2ErL2RtS1FuYnk4Z2dhMWo0Zz09
Passcode
832077
and
UR Wegmans Hall
Room 1201
250 Hutchison Rd
Rochester, NY 1462
You can park in the Trustee Lot. The lot does have a gate with a code but the gate should be open at the time of the meeting, and so you should not need a code. If you find that you do need the code send me a message at any time and I will send it to you.
Map of the path from the Trustee Lot to Wegmans Hall: https://imgur.com/a/FcAj7tf