Effective mining operations require proactive monitoring—you need to know about problems before they significantly impact your profitability. Foreman's alerts and triggers system allows you to automate notifications and actions based on the conditions you define, ensuring you're informed of issues immediately and can respond quickly.
Why Use Alerts & Triggers?
Alerts notify you when problems occur. Triggers automatically fix common problems.
The difference:
- Alert: "Miner offline" → sends you an email
- Trigger: "Miner offline" → automatically restarts it, then alerts you only if restart fails
This minimizes downtime and reduces alert fatigue.
Essential Alerts to Create
1. Offline Miner Alert
When: Miner offline for 5+ minutes
Why: Your most critical alert—know immediately when miners stop working
Action: Email + dashboard notification
2. Low Hashrate Detection
When: Hashrate below 85-90% of expected for 15-30 minutes
Why: Catches failing hashboards or thermal issues early
Example: S19 Pro at 110 TH/s → alert at <93.5 TH/s
3. High Temperature Warning
When: Temperature exceeds safe threshold for 5-10 minutes
Threshold: Manufacturer max minus 5-10°C (e.g., alert at 75-80°C if max is 85°C)
Why: Prevents thermal damage and identifies cooling failures
4. Pickaxe Offline (Critical)
When: Pickaxe disconnected for 2-3 minutes
Why: If Pickaxe is offline, you're blind to all issues at that site
Action: High-priority email
5. Pool Connection Loss
When: No shares submitted for 10-15 minutes
Why: Miners might appear online but not actually mining
Essential Triggers to Create
1. Auto-Restart Offline Miners
When: Miner offline for 2-3 minutes
Action: Restart miner software
Retry: 1-2 times with 10-minute cooldown
Rate limit: Max 3-5 attempts per miner per day
Failure: Send alert if restart fails
This is your most valuable trigger.
2. Auto-Adjust Fan Speed
When: Temperature exceeds 75°C for 5 minutes
Action: Increase fan speed to 100%
Note: May increase power consumption and noise
3. Tag Underperforming Miners
When: Hashrate below 90% for 1+ hour
Action: Add tag "performance-issue"
Benefit: Review all problematic miners in batch later
4. Pool Failover
When: Primary pool disconnected for 10+ minutes
Action: Switch to backup pool
Benefit: Maintains mining during pool outages
Best Practices
Avoid Alert Fatigue
- Use 5-minute thresholds, not 30 seconds
- Let triggers handle common issues automatically
- Bundle low-priority events into daily digests
- Review and disable noisy alerts monthly
Set Appropriate Thresholds
Too sensitive: Constant false alarms
Too lenient: Miss real problems
How to tune:
- Start with manufacturer recommendations
- Monitor for 1-2 weeks
- Adjust based on false positives
- Document your reasoning
Example:
- Initial: Alert at temp >75°C
- Week 1: 50 false alerts (hot facility, normal operation)
- Adjustment: Alert at temp >82°C for 10+ minutes
- Result: Only genuine thermal issues trigger
Organize by Priority
Critical (immediate response):
- Pickaxe offline
- 10+ miners offline simultaneously
- Facility-wide hashrate drop
High (1 hour):
- Individual miner offline
- High temperature warnings
- Pool connection issues
Medium (8 hours):
- Low hashrate on individual miner
- Fan speed anomalies
Low (daily digest):
- Miners that auto-recovered
- Minor performance variations
Phased Implementation
Week 1: Critical Alerts Only
- Offline miners (5-min threshold)
- Pickaxe offline (2-min threshold)
- High temperature (80°C for 10 min)
Week 2-4: Add Automation
- Auto-restart offline miners
- Monitor trigger success rates
- Adjust thresholds
Month 2+: Advanced
- Performance monitoring
- Auto-adjust fan speeds
- Tagging and categorization
Common Issues
Alert not firing:
- Verify alert is enabled/active
- Check condition parameters
- Test with known condition
Too many alerts:
- Increase duration thresholds
- Use triggers to auto-resolve issues
- Switch to digest notifications
Trigger not executing:
- Check trigger logs for errors
- Verify miners are accessible
- Test action manually first
Emails going to spam:
- Add Foreman sender to allowed senders
- Check email filters
Recommended Starter Setup
Week 1 Alerts:
- ✓ Offline miners (5 min)
- ✓ Pickaxe offline (2 min)
- ✓ High temperature (80°C, 10 min)
Week 2 Triggers:
- ✓ Auto-restart offline miners (2 min delay, max 3/day)
- ✓ Auto-increase fan speed (75°C threshold)
Month 2 Additions:
- ✓ Low hashrate alerts (85%, 30 min)
- ✓ Pool connection monitoring
- ✓ Performance issue tagging
Start simple, then expand as you learn the system.
Comments
0 comments
Please sign in to leave a comment.