Question about FLOPs and Latency Measurement (Table 1)

[Dayoung-Kil]

Hello.
Thank you for sharing this excellent work.

I have a question regarding the FLOPs and latency results reported in Table 1 of the paper. I was wondering how these metrics were measured. Could you kindly share the specific methodology or any related code used for computing FLOPs and latency?

Thank you very much for your help.

[Gumpest]

Hi, @Dayoung-Kil

We have already integrated the code for efficiency analysis in the repository.

When you run our latest version, the model will print the real-time efficiency metrics (including Equal Tokens, Prefill Time (ms), and TFLOPs) directly in the log during inference. This will allow you to monitor and analyze the computational cost and savings dynamically.