👉🏽 I’ve been doing Algorithms based analytics for ages, and AI since 2016 – The most obvious thing to me is, that what was once a rather framed analytics procedure decupled from data, is now very convoluted and intertwined with it.
👉🏽 Meaning, running the same algorithm on different datasets gave you different results naturally, but you still had the same procedure running on the same features. Regression is not changing when done on different datasets.
👉🏽 Then it got a bit more complex with features being driven from data exploration instead of being driven from modeling system behavior (change or test your model of reality according to evidence), so you chose a best playing method based on KPI results, but you lost the model formula of nature’s behavior. Random forest or any ansible method is doing just that but change the data and you may have to choose another method.
👉🏽 Now with ANN, and then GenAI especially with Fine Tuning, prompt engineering and examples, all generality is lost, there is no reality model that is human readable (this is why XAI – Explainable AI is so hard) and everything is data driven.
👉🏽 My guess is why the drive for AGI is so strong – We lost our human model-view of the world (and data) and are delegating it as well, to the machine.