15 comments

  • goda90 14 minutes ago
    Reminds me of this project to generate every melody possible algorithmically in order to fight music copyright lawsuits. https://allthemusic.info/
  • davidajackson 11 minutes ago
    How would you expand this to support elements like attack ("velocity of the key-down" in piano speak), grace notes, timing etc. Would each of those be part of this model or another model? How would you model an arbitrary element (pedal, duration, etc...)
  • devonsolomon 22 minutes ago
    This is really fun. Scaler 3 starts with a chord progression and lets you break it down into musical performances and parts. Useful for ideation when producing.

    Would be fun to get a midi clock going and play some chords on my piano and have my synth start jamming along with the bass and my keyboard doing some performance. Or any combination of the above.

    • mh- 14 minutes ago
      +1 all of this. That would be incredible (this already seems very cool - excited to get home and try it!)
  • timmb 18 minutes ago
    Reminds me of Francois Pachet’s Continuator (all the way back in 2003, using hierarchical markov models)

    https://www.francoispachet.fr/continuator/

  • leobg 17 minutes ago
    I don’t have MIDI. How about whistling or playing the piano via microphone? Sounds easy. Another 6 month rabbit hole? :)
  • subhajeet2107 27 minutes ago
    This is so amazing, can you improve the quality of generation at the cost of notes per seconds ? No one can play 108 notes/sec anyways, maybe you can train the model to do CoT for better quality
  • heikkilevanto 32 minutes ago
    I would love something like that, except that I play the melody, and it produces proper 3-4 part accompaniment, preferably in good baroque style. Extra bonus if it could also write it into a file in a format suitable for music editing programs.
    • morkalork 25 minutes ago
      That's a fun idea. You could start playing the piano and it kicks in with a base and drums for a jazz band.
  • pil0u 20 minutes ago
    Even after a few years deep into AI, I find your application absolutely magic. This is very inspiring, thank you for sharing.
  • evalystai 1 hour ago
    The idea is awesome! :) However there's definitely much room for improvement, first of all rythm and composition (so there's some sense of musical form).
    • simedw 1 hour ago
      Thank you.

      Yes, I think I’ve gotten it to roughly a GPT-2 level: good enough to share, but with a lot of room left to improve. I think adding some kind of bar/measure token might help with rhythm, and perhaps some form of longer-term planning for the overall composition.

  • isoprophlex 1 hour ago
    Amazing idea! Gonna hook this up to my little synthesizer and blast some square wave arpeggiated ML music!
  • ramesh31 13 minutes ago
    But does it work, or does it just output mush after a few seconds? Current SOTA in this domain is https://github.com/EleutherAI/aria a Llama 3.2 based 1B model trained on https://github.com/bytedance/GiantMIDI-Piano which will trivially run on an iPhone these days. It's results are... pretty much useless too.
  • yoouareperfect 1 hour ago
    This is really awesome thanks for sharing
  • jwr 14 minutes ago
    > Eventually I used Gemini 3.5 Flash for pairwise evaluation

    But, but… wouldn't that be… (gasp) DISTILLATION?

    Fun project!

  • lvbyte 18 minutes ago
    [dead]
  • qmmmur 1 hour ago
    [flagged]
    • kennyadam 1 hour ago
      Is this HN? Aren't people supposed to tinker with tech for no reason other than seeing if they can? Is everything that involves a transformer now just AI BAD? Is that what the world has devolved into? Each side screaming "Orange Man Bad" and endless variations at each other?
      • meerita 50 minutes ago
        It is tiring to read these people. It feels like nothing will please them, but their own ideas, work, methods.
      • tescreal 1 hour ago
        While it is a neat parlor trick, a lot of people have specific grevience against the application to art. AI has only served to further disempower artists broadly, and arguably it pushes "art" to a lower common denominator. Try to actually situate yourself in "why" people get rankled instead of making it a thought terminating cliche.
      • dgellow 35 minutes ago
        Given the AI crowd is very loudly telling us since years how humans will be replaced by LLMs and we will all be poor and left behind if we don’t join their cult, I think it’s a perfectly reasonable reaction. Anything with AI mixed with Art or other human experience is suspicious.

        Also, yes, the orange fascist who attempted to coup his way to power, raped women, and is destroying democratic institutions is indeed bad.

        • phoghed 27 minutes ago
          No they haven’t. It’s like two guys that nobody really believes. You specifically seek that information out to get mad, then proceed to see it where it’s not. Like when someone makes a cool personal project about their hobby and it happens to involve AI.
          • dgellow 16 minutes ago
            I’m not mad and have nothing against the project.

            > No they haven’t. It’s like two guys that nobody really believes.

            It’s the entire leadership of the AI industry, in case you haven’t noticed

        • Razengan 29 minutes ago
          > Given the AI crowd is very loudly telling us since years how humans will be replaced by LLMs and we will all be poor

          Oh no, AI will take our jobs??? FUCKING LET IT!

          Who even wants to do all these jobs if we don't HAVE to??

          Ask politicians to give us UBI.

          You want to attack the shit that makes shit easier instead of attacking the 200 year old institutions in place that ensure class divisions and perpetual debt and wage slavery? Smart bugger

          • dgellow 9 minutes ago
            > You want to attack the shit that makes shit easier instead of attacking the 200 year old institutions in place that ensure class divisions and perpetual debt and wage slavery

            I have bad news for you if you think that will improve with the current deployment of AI. You will also notice I didn’t mention anything about jobs

    • perching_aix 33 minutes ago
      4) it's fun and quaint, like an odd, jazzy version of a player piano from an alternate universe
    • isoprophlex 39 minutes ago
      man hits thing

      thing go plink

      machine hear plink

      machine make many more plink

      man happy for plink is fun

      man not hit machine with club or scream on orange site

      man leave cave and touch plant

    • Razengan 45 minutes ago

        What is the goal here?
      
      To eventually prove that Intelligence™ and Creativity™ isn't special?

      Or maybe there is some other "spark" deeper within?

      When everyone can make anything as soon as they think of it, what will set us apart?