Is AI Engineering a Good Long-Term Career? Lessons from Hadoop and Spark Kirill Eremenko October 20, 2026