Chapter 19 This is too deep
"Dream? What kind of network structure is this?" Li Feifei carefully searched through the descriptions submitted by each team.
It can be seen that almost all teams' submissions describe, "Our structure is based on Alex", "We imitate Alex", "We combine Alex with traditional SVM/../..".
The methods are similar, and the results are naturally very different.
What remains is a description of how to integrate several models together.
Turning to Team Dream, there are only two names in the personnel composition column: "Fanqi Meng, Huang Tang" and no specific organizational information.
Watch the introduction of the team's algorithm, which is just a few words.
"We proposed a new Dream that enables networks with a depth of hundreds or even a thousand layers to be trained. Due to the lack of sufficient equipment, we only obtained a single weight for submission."
Meng Fanqi did it on purpose. Of course, he could briefly introduce the residuals or other main tricks in the team's submission description. But why should he do this? He must first arouse the curiosity of these people in the industry before he can
Get the most attention.
Classification top-5 error rate, 4.9%.
Such a simple number directly hit Li Feifei's heart.
The error rate of the algorithm is lower than that of humans, which is 5.1%. This has been her goal since she promoted Image in 2009, and it is also a major reason why she organized this competition.
She had even made plans to stop organizing IMAGE if a certain algorithm succeeded in breaking through this level.
But she never imagined that this day would come so quickly.
Just 400 days ago, the best traditional methods could only achieve an error rate of about 25%.
Last year, Alex's error rate of about 16, she thought it was a leap forward. Such progress can be said to occur only once in decades.
She never expected that this year’s results would give her an even more exaggerated surprise.
Dream, Dream that has exceeded human level.
Li Feifei felt that the name was really appropriate, and the result was truly dreamlike.
The detection result mAP: 0., and even carried out a dimensionality reduction attack on the second place 0.
Oh my God, who are these people? Li Feifei thought hard and couldn't think of any AI laboratory where he had heard of these names.
"Why don't you briefly describe the content of the algorithm!" Li Feifei slammed the table twice with her hand. No one can understand and understand the value of this algorithm's performance better than her, a data collector.
From the moment she saw this result, her curiosity was like a wild horse that could no longer be controlled. She really wanted to know, really wanted to know. Even if it was just a specious description or two, even if she just didn't realize it,
One or two specific terms are also good.
It's a pity that Meng Fanqi is well versed in media propaganda. Between the lines, "We have proposed a new Dream" means that the structure is completely different and has changed greatly compared to Alex, in order to enhance the curiosity of readers.
Then a bombshell was thrown, "We enable networks as deep as a hundred or even a thousand layers to be trained." Compared with last year's 8-layer champion, this number is too shocking, and it makes technical practitioners itchy.
.
Finally, I pretend to be humble, but in fact I mean that we only used relatively limited resources to obtain a result, and we will not follow you in the multi-model fusion and integration.
There is so much difference in performance, it is really unnecessary.
"Put the results page online as soon as possible." Li Feifei replied to Deng Jia, thinking to herself, no wonder the calm and steady Deng Jia had just been so reckless, "I can't bear this crime alone, I want you all to be anxious.
Like an ant on a hot pot."
The top brains are very curious. This curiosity about the unknown and the pursuit of better drives them to make results that can change human life one after another.
It may be easier to tolerate slightly similar results, because you will feel that if you think about it more carefully, test it harder, and add some small tricks, you may be able to achieve the same results.
And an even more exaggerated improvement than last year's Alex is in front of him. Even the most conceited person has to admit that he can't do it in a short time.
A larger gap makes people less suspicious and jealous, only more pure curiosity and admiration.
Meng Fanqi is not prepared to change the names of most technologies, but he only calls the Res results trained by a mixture of warm_up, batch normalization, adam optimizer and other methods called Dream.
Firstly, because he was reborn from a ten-year dream, returning to 2013 to submit Res was like a dream. In fact, he occasionally worried whether he would wake up from this dream at any time.
The second reason is because my surname is Meng, which is homophonic to Meng. If I really wanted to name Meng Subi, it would be too shameless, and it is absolutely unnecessary.
After the results of the competition came out, Tang Juan and Liu Xu also felt that life was like a dream.
Even if Meng Fanqi's code updates and small tricks can always improve the performance of the model or the training speed, even they have thought countless times, can they really win the championship?
But deep down in their hearts, they have always just doubted it and never really believed it.
Not to mention winning the championship with such a crushing attitude.
"Adobe, Microsoft, UC Berkeley, St. Petersburg, IBM, Tokyo University, National University of Singapore, Oxford, Toronto." Counting all the way, how many world-class universities and institutions are left far behind.
Even Lecun, one of the three giants of AI, personally led the team to participate in the competition this time, but he could only fail.
At the same time, just as Li Feifei asked Deng Jia to publish the results page as soon as possible, three people from Google in Mountain View, Silicon Valley, near Stanford University, immediately paid attention to the results.
They are last year's champion, the Hinton team that was acquired by Google with a large sum of money.
Alex is tall and thin, with short hair and a square face. Dressed in a classic programmer suit, his words and deeds are neat and tidy, and he feels very smart and capable.
Hinton has three-dimensional facial features, a slightly hooked nose, and looks a third like Snape. When he is expressionless, he looks very majestic and intimidating, but when he smiles, he is very contagious.
But at this moment, he really couldn't laugh.
"It's unbelievable, it's really unbelievable." Alex quickly rushed to the door of the teacher's office. He didn't bother to knock on the door and pushed the door directly in. "Teacher, have you read it? The new year..."
Before he finished speaking, Hinton slightly raised his right hand to signal him to stop.
After a long while, he slowly turned the chair around and said in a very low and deep voice, "It's so fxxking deep."
If Meng Fanqi heard this sentence, he would be very surprised. Did he not expect that Hinton, one of the three AI giants, also understands philosophy?
"Deep Dark Fantasy"
Google's investment of tens of millions to acquire the Hinton team is not a fan-chasing act. In their contract, the Hinton team plays a large role in helping them maintain their leading position in AI technology.
This time Dream has improved across generations, and the ten points at a higher position are far more valuable than Alex on his team last year. In addition, it has broken the human level, and suddenly it has given Hinton huge academic pressure that he has not seen in decades.
For the first time in a year, he lamented that Google’s money was so hot to hold.
"Who are they? Is there any chance to contact them in advance?"
The Hinton team did not participate in the competition this year and did not participate in the hosting. Naturally, they do not have the email address and other information left when the team registered. Now that this shocking result has come out, there are too many people who want this information.
The organizer cannot give to everyone, so it is better to be fair and strict to the end.
Moreover, Hinton knew Li Feifei. She just sent a message asking him to check the list, just to make himself curious, how could she provide assistance?
Chapter completed!