What’s the y axis?
The temperature scale, I think. You divide the logit output by the temperature before feeding it to the softmax function. Larger (resp. smaller) temperature results in a higher (resp. lower) entropy distribution.
No shit, sherlock, it’s sample data is the internet.
Wheres 69 then?
That’s a naughty number and we don’t allow those.
In a lot of cases there’s no naughty context to 69
Ask humans the same and most common numer is 37
Hello Veritasium enjoyer
What are you referring to?
Most probably this: https://www.youtube.com/watch?v=d6iQrh2TK98
37 is well represented. Proof that we’ve taught AI some of our own weird biases.
What’s special about 37? Just that it’s prime or is there a superstition or pop culture reference I don’t know?
If you discount the pop-culture numbers (for us 7, 42, and 69) its the number most often chosen by people if you ask them for a random number between 1 and 100. It just seems the most random one to choose for a lot of people. Veritasium just did a video about it.
Is there some human sciences theory as to why?
I didn’t know either, but it seems to be an often picked ‘random’ number by people. Here is an article about it, I didn’t read it though.
