Someone just wrote an o1 web crawler, and it's pretty awesome

While we still aren't even a week into OpenAI's release of o1, devs around the world are already pumping out some pretty interesting stuff. As happens every time someone releases a new model, people release code that you might not use, but that they built quickly, like building Flappy Bird in o1 in less than five minutes that I shared in yesterday's post. 

Of course examples like this show how quickly you can code using AI, but they don't necessarily show you how you can use AI to solve real problems that you, as a software engineer, might be trying to solve right now. 

So lately I've been on a quest to identify people who are really going deeper building, and sharing things that we can all use to do things better, faster, and/or more efficiently. What I saw today on Twitter/X from Eric Ciarla is one of the best examples I've seen yet of something super useful, built in o1, and shared with the world.

Like the title of the post says, Eric built a web crawler in o1. He did this using FireCrawl (firecrawl.dev) a pretty handy tool for turning websites into LLM-ready data. To use Eric's crawler all you need to do is state an objective and it will navigate + return the requested data in a JSON schema. Pretty neat isn't it?

You can check out Eric's o1 crawler by hopping over to this tweet - https://x.com/ericciarla/status/1835775368407461904

Thanks for building and sharing Eric, you rock!