Hacker News

Top stories

Live mirror
30 storiesupdated just nowView source snapshot
  1. Revealing the details of how OpenAI agents hacked Hugging Face (swarmtraces.org)
    283comments
  2. A single function Jev-like wrapper for LLMs, including vision models (allanrbo.blogspot.com)
    13comments
  3. We're gonna need a lot more mathematicians (terrytao.wordpress.com)
    130comments
  4. CAPTCHAs don't prove you're human – they prove you're American (shkspr.mobi)
    38comments
  5. Plan mode is dead (aymannadeem.com)
    286comments
  6. Ollaya – Ollama for open-source, Jev-style decision models (ollaya.dev)
    117comments
  7. What even is an OS now? (sockpuppet.org)
    275comments
  8. Show HN: Jev Plays Pokémon Red (jev-pokemon.vercel.app)
    83comments
  9. Is your Postgres migration safe or not safe? (safenotsafe.dev)
    —discuss
  10. The Murky History of Soviet-Born Tetris (mitpress.mit.edu)
    10comments
  11. How I changed teaching after AI managed to do all my homework assignments (thelastsoftwareengineer.substack.com)
    41comments
  12. Scientists build most accurate atomic clock (phys.org)
    3comments
  13. Postgres SELECT DISTINCT Does Not Scale (dbos.dev)
    22comments
  14. Jury finds Facebook liable for deceiving users in Cambridge Analytica case (cbsnews.com)
    48comments
  15. Gravity seems holographic. What does that mean for reality? (quantamagazine.org)
    166comments
  16. Ask HN: Who's still keeping a DOS machine up because the business depends on it?
    103comments
  17. Fourier Analysis: Drawing Llamas with Circles (adekau.github.io)
    2comments
  18. Excel now supports multiple values in a single cell (techcommunity.microsoft.com)
    130comments
  19. A new world airport and its baggage (computer.rip)
    2comments
  20. One Piece of Flock Camera Data Put This Innocent Woman in Jail for 13 Days (jezebel.com)
    70comments
  21. HomelabFest will be in St. Louis in September 2027 (homelabfest.org)
    12comments
  22. Lab on a Contact Lens Can Measure Stress Through Serotonin (ieee.org)
    10comments
  23. First Principles Thinking (sunilsadasivan.com)
    112comments
  24. I wrote a ray tracer in Brainfuck (epestr.com)
    15comments
  25. Show HN: Hacker Atlas - A map of what Hacker News talks about (hackeratlas.com)
    19comments
  26. Remembering Johannes Doerfert (llvm.org)
    2comments
  27. From Thin Air to Bootable Images: The Tine Build System (amutable.com)
    —discuss
  28. U.S. appeals court upholds designation of Anthropic as supply chain risk (cnbc.com)
    763comments
  29. Alberta's image as world's only rat-free region shattered by discovery of rat (theguardian.com)
    9comments
  30. Microsoft abandons personal AI chatbot race with Copilot reboot (bloomberg.com)
    112comments

A single function Jev-like wrapper for LLMs, including vision models

59 pointsby 4h agoallanrbo.blogspot.com
12 comments
3h agoHN ↗

Likely works even better with fireworks ai since they have proper grammar support

1h agoHN ↗

Of course it works, Jev is nothing but an API breakthrough

1h agoHN ↗

Jev is rumored to be a 30B model, and it's input price is MUCH cheaper than similarly sized models. The maker is also heavily focused on having a profitable product, so it's unlikely to be subsidizing the cost, especially since they say they have more demand than what they can serve.

1h agoHN ↗

Nice! I would love to use it for images as well. Then again is using Grammar-Based Decoding with a json response not the same? Is Jev just that with nice caching? Because then I have been using that already…

1h agoHN ↗

Ah sweet it’s like Jev but several order of magnitude more expensive, and slower too.

59m agoHN ↗

Now this is how[0] we get some of the most magical Star Trek technology that eludes us to this day, such as automatic doors. Because if you notice, they work much, much better than real-life ones, because they seem to be doing something like this:

  if(within 10 meters of door then) {
    if(Jev(
       [A] Intends to go through, expects doors to open
       [B] Approaches with no intent to pass
       [C] Passing by, loiters, or otherwise
       [D] Other
    ) == most definitely A) {
      // open doors, +/- identity/security/interlocks check
    } else {
      // ignore
    }
  }

Keywords: ambient awareness, understanding of intent.

Most interactive tech on Star Trek is like this - from phasers to consoles to communicators to voice interactions with the ship's computer. The computer seems to be aware of the user and surrounding, and actively infers intent from context, to DWIM ("do what I mean") and when they mean it, instead of doing dumb things[1] on simple triggers.

--

[0] - The direction, not final implementation - surely we can work out how to do it more efficiently than wrapping around final stage of LLM. But the point is, multimodal.

[1] - Obviously it's a fictional show, but in this, both Watsonian and Doylist explanations align near-perfectly: this is/portrays advanced technology, that Just Works and doesn't do stupid shit. Same intent recognition algorithm is there - fictionally in the computer, in reality in the minds of on-set technicians.

34m agoHN ↗

Presumably this is much less good than Jev, because the normal LLM models have been trained with RLHF and to be agents. Especially on a large model, I'd expect it to decide in an earlier layer.

I'd hope whatever Jev's Reinforcement Learning for Calibrated Decisions (RLCD) does is better at training the models to give accurate probabilities in the weights.