• 0 Posts
  • 66 Comments
Joined 1 year ago
cake
Cake day: July 2nd, 2023

help-circle
  • Sure, but I’m just playing around with small quantized models on my laptop with integrated graphics and the RAM was insanely cheap. It just interests me what LLMs are capable of that can be run on such hardware. For example, llama 3.2 3B only needs about 3.5 GB of RAM, runs at about 10 tokens per second and while it’s in no way comparable to the LLMs that I use for my day to day tasks, it doesn’t seem to be that bad. Llama 3.1 8B runs at about half that speed, which is a bit slow, but still bearable. Anything bigger than that is too slow to be useful, but still interesting to try for comparison.

    I’ve got an old desktop with a pretty decent GPU in it with 24 GB of VRAM, but it’s collecting dust. It’s noisy and power hungry (older generation dual socket Intel Xeon) and still incapable of running large LLMs without additional GPUs. Even if it were capable, I wouldn’t want it to be turned on all the time due to the noise and heat in my home office, so I’ve not even tried running anything on it yet.


  • The only time I can remember 16 GB not being sufficient for me is when I tried to run an LLM that required a tad more than 11 GB and I had just under 11 GB of memory available due to the other applications that were running.

    I guess my usage is relatively lightweight. A browser with a maximum of about 100 open tabs, a terminal, a couple of other applications (some of them electron based) and sometimes a VM that I allocate maybe 4 GB to or something. And the occasional Age of Empires II DE, which even runs fine on my other laptop from 2016 with 16 GB of RAM in it. I still ordered 32 GB so I can play around with local LLMs a bit more.


  • I’m not going to defend Apple’s profit maximization strategy here, but I disagree. Most people won’t end up buying a cable and adaptare because they already have one, and in contrast to those pieces made of plastic and metal, the packaging is mostly made of paper. I’m pretty confident that the reduction in plastic and metal makes up for the extra packaging that’s produced for the minority that does buy a cable and/or adapter.





  • I don’t understand the relevance of what you’re saying. Do you mean that the platform should have the right to allow biological females only (following the definitions of your law system)? Do you think that that’s implied when a platform is female only and defensible in court? Not a snarky remark, just genuinely curious what you mean. This case was all about gender identity discrimination and I don’t see how biological sex fits into the picture.

    She had sued the platform and its founder Sally Grover in 2022 for unlawful gender identity discrimination in its services, and claimed Ms Grover revoked her account after seeing her photo and “considered her to be male”.

    Judge Robert Bromwich said in his ruling that while Ms Tickle was not directly discriminated against, her claim of indirect discrimination was successful as using the Giggle App required her “to have the appearance of a cisgender woman”.

    Judge Bromwich said the evidence did not establish Ms Tickle was excluded from Giggle directly “by reason of her gender identity although it remains possible that this was the real but unproven reason”.






  • In my opinion it’s more useful to look at grams of protein per kcal. You can only eat so many calories in a day, so that dictates your protein intake for a large part. If you eat 2000 kcal worth of peanuts, you’d ingest 80 grams of protein. With chickpeas that would be 110 grams and with chicken breast 425 grams. You don’t eat just protein rich things, so the higher the value, the higher your chances of ingesting enough protein when combined with (other) vegetables, grains, rice, oil, etc.

    I know that some people will read this comment as if I’m promoting meat consumption, so let me add that I firmly believe that the world would be a better place if we ate a lot less meat. I’m just using these examples for demonstration purposes, as they’re all at the right side of the graph. It’s always an option to supplement with a plant based protein powder.


  • In my opinion it’s more useful to look at grams of protein per kcal. You can only eat so many calories in a day, so that dictates your protein intake for a large part. If you eat 2000 kcal worth of peanuts, you’d ingest 80 grams of protein. With chickpeas that would be 110 grams and with chicken breast 425 grams. You don’t eat just protein rich things, so the higher the value, the higher your chances of ingesting enough protein when combined with (other) vegetables, grains, rice, oil, etc.

    I know that some people will read this comment as if I’m promoting meat consumption, so let me add that I firmly believe that the world would be a better place if we ate a lot less meat. I’m just using these examples for demonstration purposes, as they’re all at the right side of the graph. It’s always an option to supplement with a plant based protein powder.


  • Exactly. I once visited a seed bank and there was some text along the lines of “we store these seeds at -60 °C which is 3 times as cold as your typical freezer” (for Americans: a freezer typically is about -20 °C). Yeah, no, that’s not how it works. With Kelvin you can actually do math like that, because 0 K is the absence of heat zero thermal energy.



  • I don’t get why that would be a nightmare. In my country the electricity prices change per hour for dynamic contracts (they just follow the energy market) and with normal usage it’s cheaper on average than fixed contracts, including those with peak and off-peak rates. For gas it’s a day price, again same as the energy market. For both electricity and gas the prices for the next calendar day are published in the afternoon (that’s how the energy market works). The companies charge a little extra per unit and a small fixed fee per month.

    Contracts with fixed rates (including nighttime and daytime rates) have to buy in advance, which means that unforeseen circumstances are included in the price and they also have to account for the fact that they might need to buy extra or sell off their excess based an actual usage.



  • I think many people peddle just as hard on an electric bike, so the 5.5 kWh/km is a given, the rest is the energy required to go faster. Since air resistance increases with the square of the speed, it might very well be the case that 14 kWh/km at 25 km/h is more efficient than what the human alone would need to deliver for the same speed.

    Edit: I failed to take into account that for the human at the same level of effort the power remains constant, not the energy per kilometer. Going faster at the same power output would reduce the energy expenditure per kilometer for the human to about 4 kWh/km, which would indicate that 10 kWh/km is being delivered by the motor to go faster.

    That being said, it might be the case that they just calculated the energy needed to move the bicycle without taking the energy efficiency of the digestive system into account.


  • I don’t doubt the fact that they take some margin to extend the lifetime of the battery, but if we take iPhones as an example, they:

    • charge at a slower rate when nearing 100%
    • try to postpone charging the final 20% until the last moment before disconnecting from the wall outlet
    • can be software capped at 80% by the user (in newer models)

    This makes me suspect that that the margin between what’s reported in software as 100% and the actual capacity of the battery is less than 20%. This also makes sense from the standpoint of the consumer expecting a long battery life on their expensive high-end device, putting pressure on the companies to make the margin smaller and the charging algorithms smarter. Just my observations, of course.