Welcome To The Foreman Knowledge Base

Module 2: Setting Up Alerts and Triggers

Effective mining operations require proactive monitoring—you need to know about problems before they significantly impact your profitability. Foreman's alerts and triggers system allows you to automate notifications and actions based on the conditions you define, ensuring you're informed of issues immediately and can respond quickly.

Why Use Alerts & Triggers?

Alerts notify you when problems occur. Triggers automatically fix common problems.

The difference:

  • Alert: "Miner offline" → sends you an email
  • Trigger: "Miner offline" → automatically restarts it, then alerts you only if restart fails

This minimizes downtime and reduces alert fatigue.

Essential Alerts to Create

1. Offline Miner Alert

When: Miner offline for 5+ minutes
Why: Your most critical alert—know immediately when miners stop working
Action: Email + dashboard notification

2. Low Hashrate Detection

When: Hashrate below 85-90% of expected for 15-30 minutes
Why: Catches failing hashboards or thermal issues early
Example: S19 Pro at 110 TH/s → alert at <93.5 TH/s

3. High Temperature Warning

When: Temperature exceeds safe threshold for 5-10 minutes
Threshold: Manufacturer max minus 5-10°C (e.g., alert at 75-80°C if max is 85°C)
Why: Prevents thermal damage and identifies cooling failures

4. Pickaxe Offline (Critical)

When: Pickaxe disconnected for 2-3 minutes
Why: If Pickaxe is offline, you're blind to all issues at that site
Action: High-priority email

5. Pool Connection Loss

When: No shares submitted for 10-15 minutes
Why: Miners might appear online but not actually mining

Essential Triggers to Create

1. Auto-Restart Offline Miners

When: Miner offline for 2-3 minutes
Action: Restart miner software
Retry: 1-2 times with 10-minute cooldown
Rate limit: Max 3-5 attempts per miner per day
Failure: Send alert if restart fails

This is your most valuable trigger.

2. Auto-Adjust Fan Speed

When: Temperature exceeds 75°C for 5 minutes
Action: Increase fan speed to 100%
Note: May increase power consumption and noise

3. Tag Underperforming Miners

When: Hashrate below 90% for 1+ hour
Action: Add tag "performance-issue"
Benefit: Review all problematic miners in batch later

4. Pool Failover

When: Primary pool disconnected for 10+ minutes
Action: Switch to backup pool
Benefit: Maintains mining during pool outages

Best Practices

Avoid Alert Fatigue

  • Use 5-minute thresholds, not 30 seconds
  • Let triggers handle common issues automatically
  • Bundle low-priority events into daily digests
  • Review and disable noisy alerts monthly

Set Appropriate Thresholds

Too sensitive: Constant false alarms
Too lenient: Miss real problems

How to tune:

  1. Start with manufacturer recommendations
  2. Monitor for 1-2 weeks
  3. Adjust based on false positives
  4. Document your reasoning

Example:

  • Initial: Alert at temp >75°C
  • Week 1: 50 false alerts (hot facility, normal operation)
  • Adjustment: Alert at temp >82°C for 10+ minutes
  • Result: Only genuine thermal issues trigger

Organize by Priority

Critical (immediate response):

  • Pickaxe offline
  • 10+ miners offline simultaneously
  • Facility-wide hashrate drop

High (1 hour):

  • Individual miner offline
  • High temperature warnings
  • Pool connection issues

Medium (8 hours):

  • Low hashrate on individual miner
  • Fan speed anomalies

Low (daily digest):

  • Miners that auto-recovered
  • Minor performance variations

Phased Implementation

Week 1: Critical Alerts Only

  • Offline miners (5-min threshold)
  • Pickaxe offline (2-min threshold)
  • High temperature (80°C for 10 min)

Week 2-4: Add Automation

  • Auto-restart offline miners
  • Monitor trigger success rates
  • Adjust thresholds

Month 2+: Advanced

  • Performance monitoring
  • Auto-adjust fan speeds
  • Tagging and categorization

Common Issues

Alert not firing:

  • Verify alert is enabled/active
  • Check condition parameters
  • Test with known condition

Too many alerts:

  • Increase duration thresholds
  • Use triggers to auto-resolve issues
  • Switch to digest notifications

Trigger not executing:

  • Check trigger logs for errors
  • Verify miners are accessible
  • Test action manually first

Emails going to spam:

  • Add Foreman sender to allowed senders
  • Check email filters

Recommended Starter Setup

Week 1 Alerts:

  • ✓ Offline miners (5 min)
  • ✓ Pickaxe offline (2 min)
  • ✓ High temperature (80°C, 10 min)

Week 2 Triggers:

  • ✓ Auto-restart offline miners (2 min delay, max 3/day)
  • ✓ Auto-increase fan speed (75°C threshold)

Month 2 Additions:

  • ✓ Low hashrate alerts (85%, 30 min)
  • ✓ Pool connection monitoring
  • ✓ Performance issue tagging

Start simple, then expand as you learn the system.

 

Was this article helpful?

0 out of 0 found this helpful

Have more questions? Submit a request

Comments

0 comments

Please sign in to leave a comment.