• 3 Posts
  • 36 Comments
Joined 3 years ago
cake
Cake day: March 15th, 2023

help-circle

  • By IO heavy I meant db operations or other external requests. When the request handler starts, it waits for the IO to be completed. While it waits, it can accept other requests and so on, so the bottleneck is the IO in my case, not the request parsing.

    I imagine it like this (imaginary numbers):

    • DB operation: 20ms
    • Express request handler: 1ms
    • Brhama request handler: 0.5ms

    Which case, it wouldn’t matter which http framework to use. However, there are probably other use-cases.





  • The concept of understanding implies some form of meta-knowledge about the subject.

    That can be solved if you teach it the meta-knowledge with intermediary steps, for example:

    prompt: 34*3=
    
    step1: 4*3 + 30*3 = 
    step2: 12 + 10*3*3 = 
    step3: 12 + 10*9=
    step4: 12 + 90 =
    step5: 100 + 2 =
    step6: 102
    
    result: 102
    

    It’s hard to find such learning data though, but e.g. claude already uses intermediary steps. It preprocesses your input multiple times. It writes code, runs code to process your input, and that’s still not the final response. Unfortunately, it’s already smarter than some junior developers, and its consequence is worrying.


  • But LLMs are not simply probabilistic machines. They are neural nets. For sure, they haven’t seen the world. They didn’t learn the way we learn. What they mean by a caterpillar is just a vector. For humans, that’s a 3D, colorful, soft object with some traits.

    You can’t expect that a being that sees chars and produces chars knows what we mean by a caterpillar. Their job is to figure out the next char. But you could expect them to understand some grammar rules. Although, we can’t expect them to explain the grammar.

    For another example, I wrote a simple neural net, and with 6 neurons it could learn XOR. I think we can say that it understands XOR. Can’t we? Or would you say then that an XOR gate understands XOR better? I would not use the word understand for something that cannot learn. But why wouldn’t we use it for a NN?





  • I’m running Arch for a very long time. I agree this is not a distro for general audience. I disagree, however, that it is not stable. When I’m doing work I don’t update my system. I enjoy my stable configuration and when I have time, I do update, I curiously watch which amazing foss software had an update. And I try them. I check my new firefox. I check gimp’s new features. etc… or if I have to do something I easily fix it, like in no time because I know my OS. Then I enjoy my stable system again.

    Do you want to know what’s unstable? When I had my new AMD GPU that I built my own kernel for, because the driver wasn’t in mainline. And it randomly crashed the system. That’s unstable.

    Or when I installed my 3rd DE in ubuntu and apt couldn’t deal with it, it somehow removed X.org. And I couldn’t fix it. That’s also something I don’t want. Arch updates are much better than this.