WeightWatcher, an Open-Source Diagnostic Tool for Analyzing Deep Neural Nets
Details
By Dr. Charles H. Martin, University of Chicago in Theoretical Chemical Physics, NSF Fellow, CalculationConsulting.com
https://acm-org.zoom.us/j/93412946086?pwd=eWhWRGZKV0pmTk85S2pYVzhMS2lQZz09
SCHEDULE: (times in PT, in the San Francisco bay area)
6:50 connect to streaming
7:00 Event and speaker introduction
7:10 Speaker begins
STREAMING INFO:
TALK DESCRIPTION:
WeightWatcher (WW): is an open-source, diagnostic tool for analyzing Deep Neural Networks (DNN), without needing access to training or even test data. It can be used to:
- analyze pre/trained PyTorch, Keras, DNN models (Conv2D and Dense layers)
- monitor models, and the model layers, to see if they are over-trained or over-parameterized
- predict test accuracies across different models, with or without training data
- detect potential problems when compressing or fine-tuning pre-trained models
- layer warning labels: over-trained; under-trained
as well as several new experimental model transformations, including:
- SVDSmoothing: builds a model that can be used to predict test accuracies, but only with the training data.
- SVDSharpness: removes Correlation Traps, which arise from sub-optimal regularization pre-trained models.
https://github.com/CalculatedContent/WeightWatcher
SPEAKER BIO:
I do machine learning, deep learning, data science, and AI software development, and with extensive domain experience in NLP for Search Relevance (as well as Text Generation and Quantitative Finance).
I have personally developed machine learning (ML) systems and helped get them into production at companies including Roche, France Telecom, GoDaddy, Aardvark (Google), eBay, eHow, Walmart, Barclays/BGI, and Blackrock. Recently I was both a consultant and FTE distinguished engineer at GLG, a very prestigious international consulting firm, where I developed AI methods for the search and recommendations platform.
I provide scientific consulting to the Page family office at the Anthropocene Institute, advising on areas of nuclear and quantum technologies with an eye toward climate change.
I do scientific research in collaboration with UC Berkeley on the foundations of AI and am the lead on the WeightWatcher project: pip install weightwatcher.
In 2011, I helped Demand Media / eHow become the first $1B IPO since Google: http://www.youtube.com/watch?v=6Cv_Rv56TA0
I was at Aardvark, acquired by Google and featured in the Lean StartUp, and a subject matter expert (SME) in ML at eBay.
At my first startup, in the late 90s, I developed semi-supervised ML algoRITHM for personalized search.
I offer over 15 years of commercial data science, software engineering, and ML experience. I am a full stack developer for web, object-oriented, and numerical programming. This includes java, ruby, python--and even dev ops.
I was coding on the Cray XMP in High School. I invented a Monte Carlo method for non-eq condensed matter systems and published--at 19. I am a national math contest winner.
My PhD is in Theoretical Chemistry from U Chicago. I was an NSF Fellow (1 of 2 nationwide).
https://www.linkedin.com/in/charlesmartin14/