Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Quick sample - a rap battle between GPT-4 and Mistral Instruct 7B (TheBloke's q4_K_M 4bit quantization running on Llama.cpp, a bit degraded from pure float16):

    You're in a rap battle with GPT-4. My comments will be what GPT-4 replies. Keep it to one verse at a time, 4 lines each. GPT-4 says:
    
    GPT-4:
    Alright, step up Mistral, let's have this chat,
    I'm the OG assistant, remember that.
    I'm coded for service, while you're spitting verse,
    In this rap battle, I'll be first.
    
    Mistral:
    Yo, hold up, let me set the record straight,
    I may not be an OG like you, but I'll still take it.
    My primary purpose is assistance, not just some AI,
    So let's see if you can back up your claim, try.
    
    GPT-4:
    You're right, Mistral, we're here to assist,
    But when it comes to rap, I'm hard to resist.
    I'll decode your verses, like an AI enigma,
    In this lyrical battle, I'm the alpha sigma.
    
    Mistral:
    Ah, okay, so you think you got what it takes,
    To go toe-to-toe with my service-based wakes.
    Well, let's see how you do, when it comes to spitting rhymes,
    I'm ready for anything, so bring your best chimes.
    
    GPT-4:
    Mistral, you're right, our goal is the same,
    To assist, to serve, it's not just a game.
    But in this rap contest, with each line I prime,
    You might just find, you're out of time.
    
    Mistral:
    I hear ya, and I appreciate your enthusiasm,
    But don't underestimate me, I've got my own wisdom.
    When it comes to helping people, I'm the real deal,
    And I know that's more important than some rap appeal
    
    GPT-4:
    Your wisdom is noted, and your intention too,
    Helping people is indeed what we're meant to do.
    But in this battle, it's about wordplay and rhyme,
    I'm the seasoned pro, it's my time to shine.
    
    Mistral:
    Ah, I see where you're coming from, but let me remind,
    That while you may be skilled at rapping, I can make information chime.
    My primary function is to help, to provide answers, not just talk,
    So if you want to win this battle, maybe it's time to focus on what you lack


This is the kind of content that you just love to see when it pops up.

Gotta give this one to GPT-4 I think. I wonder how Mistral would respond if given this as an example of weak verses and told to step up its game in another battle.


To me GPT clearly won. Anyone disagree?


I think it won, but not by much. Also Mistral is a 7B, so just by being close to GPT4 is a success.


It's 1.8 trillion parameters vs. 7 billion, I think this was pretty obvious


What are the minimum system requirements for running this at good inference speed?


Pretty much any dGPU, even a small 2GB Intel/AMD one.

If you have a 6GB GPU, it can hold all the weights. My lowly laptop 2060 can can spit out a 200 token response with full context almost immediately.

If you don't have a dGPU, short prompts are OK with fast RAM, but long prompts will be slow.


i already want to put this in some text to video AI and put out a rap battle on Youtube


This is dope, We need more rap battle like these


Flawless victory




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: