Varnish bandwidth useage log

dnwk

Hi
Is it possible in Varnish to log the bandwidth use by domain? How to configure it?

If varnish cannot do this task, is there any alternative?

dnwk

What if I put a NGINX in front of Varnish? Will that make it easier?

Dorkfiles

Ng+var is very common on high loaded servers or hardcore wordpress sites getting digg'd

dnwk

So, the question is how do I monitor per vhost bandwidth usage in NGINX?

Dorkfiles

well you are running ng on top of apache so... pretty much the same thing youve been doing assuming your using a correct setup everything still hits apache, ng is just a proxy

dnwk

No. NG hits varnish then go to whatever places. So I need to know exactly how much bandwidth goes out of Nginx to user

tchen

Since you've put nginx in front of varnish, you could try using the munin plugin https://github.com/joanpc/nginx_vhost_traffic

dnwk

@tchen said:
Since you've put nginx in front of varnish, you could try using the munin plugin https://github.com/joanpc/nginx_vhost_traffic

I tried. It did not work well. Too many bugs. Also, it show you current bandwidth usage. It did not show cumulative. So there is no way for you to know how much bandwidth it used last month or the one before.

tchen

@dnwk As a follow up, you might want to consider logstash/statsd monitoring. I think you could collect varnishlog via lumberjack and extract the bytes transferred given the request host. Totally in the idea stage only, as I was playing with logstash lately and remembered your plight.