Hey Hunters! :) My name is Amos and I work at AI21 Labs. A few months ago I had a cool idea: what if we would create a text-based chatroulette-style game that matches humans with AI bots, and after a few messages you get to guess if you’re talking to another fellow player or an AI bot? Well, our team decided to go ahead and build it, and here we are! I’m so f***ing excited to share this cool new web game and AI experiment called “Human or Not?” with the community. It’s a “social Turing game” that lets you find out if you can tell the difference between an AI and a human. So how does it work? The system randomly connects you to either an AI bot or another human like yourself playing the game. During a two minute chat you can ask or talk about whatever you want. Once the conversation ends, you have to choose, and only then the game reveals the truth - if that was an AI or another player. The bots are based on all the latest and greatest models: our very own Jurassic-2, as well as GPT-4, Claude and other LLMs. The game is free to play, and its goal is just to help all of us better understand the nature of these AI models in the context of not just a productivity tool, but members of our online world. We hope this will be a weird, crazy, thought provoking and mostly funny experience, and we would love for the Product Hunt community to be among the first to play with it. We are curious to see which strategies you will choose in order to expose the bot/human in the game. We would also appreciate any feedback, and if you liked the game - help us spread the word around! :) Thanks so much! Amos & the team

Lets do this! The game already beat me so many times :-O

Hey, I just tried it and got some interesting results :) Putting the fun side aside, I think that what you guys are doing is incredibly important moving forward. Looking not so far into the future, this is going to be an issue for many people and businesses. I believe that it's important to start looking into tech that will be able to look behind the scenes and make sense of what is working with us behind the curtains. Great way to start this research using real-world experience. Good luck on your launch, it is one of the more important ones in more the one way.

The game has actually beaten me. 😅 I thought I was chatting with a robot, and it turned out I just talked to a human. 🤔 This is actually interesting and in these times where AI is really shaping our lives, it's even more interesting.

Just played a round - asked the other side "should I buy bitcoin?" and got the response "What is bitcoin?" - such a dead giveaway... c'mon humans, you can do better!

Love this concept! I’ll be sure to go give it a try now. Love things like this that use technology to challenge your brain. Great way to bring Chat GPT and gamify it! Congratulations on a great launch! We’re launching tomorrow 🤞🏻

Man, this was fun, in the next update please increase the time to write our answers. I didn't get the time to write them properly.

Whoa! What a nice game. I played this game around 10 times, and many times I was wrong in selecting Human or bot, but I really enjoyed it. The best thing about this is, the clean UI, and kept it so simple that you can use it without any how-to guide!

Wow, this sounds like a really fun and interesting concept! I can't wait to try it out and see if I can tell the difference. How many different AI bots are available in the game, and are they all based on different language models?

Just played a round asking 'Pineapple on Pizza. Good or Bad?'. From the reaction it was pretty obvious who was on the other side.😅This kind of reminds me of the game 'The Talos Principle'. The entire game (apart from solving puzzles) you're trying to figure out who you are, what makes a human - a human and have chats with someone on a terminal who you don't know is a human or not. Fun experiment ?makers

I've tried three times, and all three times I've been unable to say more than a couple words because I or stranger have exceeded the time allowed to reply. I wish the time limit was longer.

Challenge accepted! This feels like Chat Roulette for 2023—I love it!

Game is cool, but there are some dead giveaways (like - only humans don't finish their sentences in time and so on). It would be nice if there were some additional points if you manage to fool the other side. So people would try to sound like an AI, which would make it harder to guess. Or even better - points should be only for fooling the other side, not for guessing correctly. It would be nice if you could experiment with that I think.

Wow, I really enjoyed using this app! It's pretty amazing how it can tell if a text was written by a person or a computer. I had fun trying it out and seeing if I could guess which was which. I should keep in mind though that sometimes the app might make a mistake, so it's not perfect. Overall, I think it's a really neat tool that could be useful for lots of different things. Congrats on the launch!

Love social experiments like this :)

This sounds like a really interesting game and experiment! How did you ensure that the AI bots don't give themselves away too easily during the two-minute chat?

I really enjoy the idea for this, however I think it would be awesome if it also showed if the other human thought I was a bot or a human. Also, maybe a profanity filter or a report button as I've encountered some profanities in my short visit on the site already made by other humans.

Incredible concept! There is a dead giveaway though… Humans cannot type ‘ but bots can, so when anyone see “I’m” instead of “Im” they know it’s a bot.

This is so much fun! Kudos @amos_meron and the AI21 team 🤩

Love the game! SO accurate for these times.