Audio Tokens Part 11: The Hunt

Today I’m hunting down which commit moved my validation mAP from 0.15 to 0.41. One of two things happened here.

• A large bug was fixed, and performance was improved.
• A large bug was introduced, and the improved performance is a lie.

Time to track that down, so I’m going back commit by commit to find where the bump happened. Apparently I did so many small housekeeping commits back there that I just missed the big bump in reported performance. Let’s go back and find it:

commit - approx peak val mAP a98862b - 0.44 back one commit… 6c92de9 - 0.13

That was easy. Now let’s look at that commit. Hopefully it doesn’t touch every fi–it touches every file. Digging in!