The Unclear Impact

language model, food, being silly with rwkv-4-pile-3b-instruct-test2-20230209 on a cpu
> Q: what is a good recipe for bbq ribs?
>
> A: 1. Make the garlic herb rub.
> 2. Preheat oven to 200°F (93°C).
> 3. Soak the ribs in water for 1 hour.
> 4. Soak in 5% salt for 1 hour.
> 5. Rinse ribs, pat dry, and rub with olive oil.
> 6. Season the ribs with salt and pepper.
> 7. Place the ribs on a wire rack and roast for 45 minutes.

5/7, had my oven at 93C for two hours while the ribs were soaking in water and... saline? blobfoxbreadsnootgoogly

interestingly, #rwkvstic does not get any faster if i torch.set_num_threads(8) and torsh.set_num_interop_threads(8) compared to single-threaded, but uses a whole lot more cpu. but with bfloat16 instead of float32 it doesn't even use more cpu!

#rwkv #pytorch #llm
replies
0
announces
0
likes
0