Algorithm to cluster chart type

manpreet Best Answer 2 years ago

So, I have more than 20,000 entities. Each entities has their own data point (time series). Let say entities A1 to A20000. A1 has data point from year 1 to year 60. A2 has data point from year 5 to 60, and so on. We can make some plot year vs value each year for each entities.

My task now is to make a cluster of the entity based on the shape the chart they make. For example, A1 data point chart (assume barplot) will make quadratic-like shape, A2 data point chart will make exponential -like shape, and so on. There would be some entity with random chart shape like scattered.

Is there any algorithm to create this type of clustering? I tried to create just 1 shape detection algorithm, monotonic increase shape, and I think it works good but I need an automatic shape detection algorithm. My method also still not robust enough to detect some small fluctuation. For example in the monotonic increase shape (the data in the newer year is greater than its previous year), if some data in a year dropped a quite big, it failed to detect it is monotonic increase type although generally speaking, it is monotonic increase.

Any suggestion?

manpreet 2 years ago