Join Log in
Score:0
Aditya K avatar Server

Can logstash "pull" data?

cn flag
Aditya K

I have two servers. Server A is running Elasticsearch and Logstash. Server B is running filebeat and is also the server which contains all the logs I'm trying to analyse.

Server A is behind a firewall, it can reach out to the internet, but there's no possibility of allowing any inbound traffic.

Server B is in AWS and under my control for inbound and outbound traffic.

Is there any way I can get data from server B to server A's logstash? Filebeat in the usual way would have to be able to push data to logstash, but this isn't possible in my scenario.

29
0 + 0
Score:0
avatar Server
cn flag
sysadmin1138

With Filebeat (or any other Beat) on B, your options are limited to:

  • Elasticsearch — not viable here.
  • Redis — Some possibilities.
  • Kafka — Similar possibilities.

If A can call into B's network spaces, you can have B's Filebeat deposit logs into Redis (or Elasticache Redis), or Kafka (or AWS Managed Kafka Services), where the Logstash on A can connect to Redis or Kafka.

For the security minded, Redis now has the ability to support both authentication and TLS over the connection. In versions 6.x and later, especially the AWS varieties, Redis has actual ACL support.

0 + 0
ธงชาติไทย
Elon Musk
I sit in a Tesla and translated this thread with Ai:

mangohost

Post an answer

Most people don’t grasp that asking a lot of questions unlocks learning and improves interpersonal bonding. In Alison’s studies, for example, though people could accurately recall how many questions had been asked in their conversations, they didn’t intuit the link between questions and liking. Across four studies, in which participants were engaged in conversations themselves or read transcripts of others’ conversations, people tended not to realize that question asking would influence—or had influenced—the level of amity between the conversationalists.