Basically a deer with a human face. Despite probably being some sort of magical nature spirit, his interests are primarily in technology and politics and science fiction.

Spent many years on Reddit before joining the Threadiverse as well.

  • 0 Posts
  • 1.2K Comments
Joined 2 years ago
cake
Cake day: March 3rd, 2024

help-circle






  • Whether inference is profitable or not is not a global yes/no question. It depends heavily on the circumstances, what you’re using it for and what you’re charging for it. A lot of the money being invested in research right now is going into making inference cheaper, which would of course make it more profitable to sell at current price points. Or just run it yourself, local models are getting quite capable these days.

    I wouldn’t bet on any specific company being the ones to survive this, especially not first-movers like OpenAI. More likely they’ll spend their money blazing the trail and the ones to profit from it will be the ones who followed along behind. When a company goes bankrupt it doesn’t poof out of existence, its assets get sold off at pennies on the dollar and then whoever bought those assets gets a chance at running them without the overhead of the previous company’s debt.


  • FaceDeer@fedia.iotoTechnology@lemmy.worldIs AI Profitable Yet?
    link
    fedilink
    arrow-up
    6
    arrow-down
    2
    ·
    6 days ago

    This seems somewhat misleading. Lots of products take a lot of investment in them for many years before they reach profitability. The Boeing 787 Dreamliner, for example, was in development for 7 years and another three years after that before it was profitable. The Falcon 9 rocket took 13 years to develop and now it’s the most profitable satellite launcher around. The Dyson bag-free cyclonic vacuum cleaner took 15 years to develop.

    Most of this AI stuff has only been in heavy development since ChatGPT burst upon the scene in 2023. It’s not unreasonable to see the industry still heavily into the investment and development side of things.











  • While the current splashy “state of the art” models in terms of cognitive ability are American, IMO the real foundation for future AI is coming out of China these days. It’s not quite as smart but they’re focusing heavily on making AI training and inference cheaper in terms of compute (and therefore more efficient in terms of energy usage). It’s a mother-of-invention situation, sure - they’ve been cut off from the latest and greatest NVIDIA cards so they’re having to find ways to make do with less powerful hardware. But that’s going to be super important once AI is “good enough” for various real world tasks and the most powerful models aren’t needed for most activities.



  • Yeah, I wouldn’t use a framework that didn’t let you select the basic model. I’m just thinking about having it automatically switch to a different one during the review “phase”. It’s not as popular a coding agent these days but I like using Google’s Antigravity and it’s capable of being told to go through the sequence of steps “plan - > write documentation -> implement the plan -> run unit tests -> do a code review” automatically without needing to be prompted at each step. That’s where it would be nice to have it automatically switch for the review.

    “Wear the reviewer hat now” does seem to work quite well with the same model, but if more models from different lineages are available it just seems like the right thing to do to switch to another one.