Score:0

Grafana: "Prometheus DataSource Error" after Ubuntu Apt upgrade of grafana

cn flag

I've had an instance of Graphana running for 2 years on an Ubuntu box using Prometheus as a data source.

After updating ubuntu via apt I noticed my all my dashboards went down. Going to the Prometheus DataSource settings I see the error Error reading Prometheus: Metric request error

Looking in my apt upgrade log it looks like things broke with the update batch

Upgrade: libglapi-mesa:amd64 (21.0.3-0ubuntu0.3~20.04.4, 21.0.3-0ubuntu0.3~20.04.5),
libgl1-mesa-dri:amd64 (21.0.3-0ubuntu0.3~20.04.4, 21.0.3-0ubuntu0.3~20.04.5), 
grafana:amd64 (8.2.5, 8.3.0), 
mesa-vulkan-drivers:amd64 (21.0.3-0ubuntu0.3~20.04.4, 21.0.3-0ubuntu0.3~20.04.5), 
libglx-mesa0:amd64 (21.0.3-0ubuntu0.3~20.04.4, 21.0.3-0ubuntu0.3~20.04.5)

If I use curl to access Prometheus from the same machine I get results for endpoints like /metrics or api/v1/query. So it appears that Prometheus is working fine.

Also, googling the error message Error reading Prometheus: Metric request error returns zero results. So, not sure what to do here ... roll back the grafana version?

I've also posted a question in the grafana community. https://community.grafana.com/t/prometheus-ds-metric-request-error-new-error-on-upgrading-ubuntu/57443

Score:0
na flag

same thing happened to me wıth promethes. I just added http:// to URL field on prometheus data source page, it worked.

Score:0
cn flag

Downgrading from grafana/stable 8.3.0 to grafana/stable 8.2.5 resolves the issue temporarily.

This is using the archive https://packages.grafana.com/oss/deb

However, I also upgraded to 8.3.1 and the package is still broken, so fixing an old version works but isn't an actual solution.

Not sure where to report package issues for https://packages.grafana.com to (besides their community forum).

[update] tried the Ubuntu update grafana/stable 8.3.2 but it still breaks the Prometheus DataSource.

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.