📡 Monitoring Guide — T3RN Executor Node

Monitoring your Executor node ensures availability, successful bid processing, and visibility into runtime errors or crashes.

This guide includes manual checks, automated tools (like Watchtower and Monit), and a custom health script.

---

✅ Basic Checks

Check container status:

docker ps

View live logs:

docker logs -f t3rn-executor

Filter for events:

docker logs -f t3rn-executor | grep BidReceived

---

🔁 Restart the Node

To restart the node manually:

docker restart t3rn-executor

---

📜 Run the Check Script

A custom diagnostic script check_t3rn_node.sh is included.

Run it like this:

bash check_t3rn_node.sh

What it does:

• ✅ Checks if the Docker container is running
• ⏱ Displays uptime and resource usage
• 🔁 Warns if the container is restarting too often
• 🔍 Parses logs to show:
  • Number of bids received and rejected
  • Errors count
  • Active networks
• 🌐 Validates each RPC endpoint is live via real-time eth_blockNumber requests

Tip

Use this before and after restarting or updating your node.

---

♻️ Auto-Restart with Docker

Your docker-compose.yml is already configured with:

restart: unless-stopped

This keeps the node alive on crash or server reboot.

---

🔄 Watchtower (Optional)

To automatically update your Docker container when a new image is published:

docker run -d \
  --name watchtower \
  --restart always \
  -v /var/run/docker.sock:/var/run/docker.sock \
  containrrr/watchtower

Note

This assumes you use a latest tag or rebuild your image manually.

---

🚨 Email Alerts with Monit (Optional)

Install Monit:

sudo apt install monit -y

Create a config /etc/monit/conf-enabled/t3rn-executor:

CHECK PROCESS t3rn-executor MATCHING "docker"
  START PROGRAM = "/usr/bin/docker start t3rn-executor"
  STOP PROGRAM  = "/usr/bin/docker stop t3rn-executor"

Then:

monit reload

You can also configure email alerts in /etc/monit/monitrc.

---

🧪 Suggested Routine

Task	Frequency
Run check script	Daily
Watch logs for errors	After update
Restart container	If needed
Monitor disk usage	Weekly

Stay alert. Stay rewarded 🚀

---

🧪 Advanced Manual Logs Monitoring (Optional)

# Count BidReceived events
docker logs t3rn-executor | grep BidReceived | wc -l

# Check memory usage alone
docker stats --no-stream --format "RAM: {{.MemUsage}}"