Do you remember the hype about Big data and related technologies? I don't want to make any general statement nor over simplify the situation, but the thing is that the core researchers warned several years ago that for example technologies like Hadoop have very limited scope and will not have long life. Yet many companies tried to adopt it with a more or less success, while the technologies already shifted beyond that.
On the other hand we sometimes still ignore the key important topics, like data integration. Most probably, because they are basically too complex and hard to solve - or in Stonebraker's words - we are ignoring the important problems in favor of ones that are easy to solve. Michael Stonebraker lists the following examples of most ignored problems:
- data integration
- database design and evolution
- tuning a DBMS application is way too difficult
- average DBMS takes $20M to get to production readiness
I personally believe that these are the topics most of you spend big effort with, especially, like I've already mentioned data integration , and this month's IDUG topic - application and system performance. Or is there anyone, who does not try solve these things?
There is one more thing - learning from history. In order to stay current and relevant, we need to understand the history and if possible do not repeat the mistakes, but take the lessons. For example, from a completely different presentation and another article, which I may discuss next time, I've understood that hierarchical databases are becoming attractive. I have nothing against that, but we need to understand that this is nothing very new. Remembering IMS? Yes, a great technology, a hierarchical database that can teach us important lessons.