Astra solved three DEF CON puzzles Ben Davis and his team could not, plus one no team in the world had solved. The difference was Astra's swarm workflows.
According to OpenAI's YouTube channel, Davis is a DEF CON regular who spent days on the contest with friends. He threw the hardest challenges at the model to see if it was actually new.
The full discussion can be found on OpenAI Youtube's YouTube channel.
One was a 3 by 4 grid of Rubik's cubes hiding a message. Astra solved it three out of three tries.
Another was a dress covered in multicolored beads, photographed badly across many images. The model had to see and connect details across those disparate shots to pull out the message.
