SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 2 days agoIs there a currently an accurate way to say how much power per prompt LLMs use?message-squaremessage-square25linkfedilinkarrow-up145arrow-down15
arrow-up140arrow-down1message-squareIs there a currently an accurate way to say how much power per prompt LLMs use?SnausagesinaBlanket@lemmy.world to Ask Lemmy@lemmy.world · 2 days agomessage-square25linkfedilink
minus-squareEvotech@lemmy.worldlinkfedilinkarrow-up1·11 hours agoIt will vary based on the llm, tokens and tool calls
It will vary based on the llm, tokens and tool calls