SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 2 days agoIs there a currently an accurate way to say how much power per prompt LLMs use?message-squaremessage-square25linkfedilinkarrow-up145arrow-down15
arrow-up140arrow-down1message-squareIs there a currently an accurate way to say how much power per prompt LLMs use?SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 2 days agomessage-square25linkfedilink
minus-squarelime!@feddit.nulinkfedilinkarrow-up1·1 day agoopenai actually released some figures on power use per prompt, but the caveat is that a single prompt to their services can trigger multiple responses (the “thinking” mode) so they’re not consistent.
openai actually released some figures on power use per prompt, but the caveat is that a single prompt to their services can trigger multiple responses (the “thinking” mode) so they’re not consistent.