Skip to content

[Consistency] Data Consistency across multiple years #36

Open

Description

@vibhatha

When we want to visualize the change of a particular dataset over the years, there could be a challenge we could face due to the data formats and granularity of data in various years.

For instance take 2023 the data collected about a tourism based on age ranges could have K number of age ranges where for 2024 report it could have K1 number of date ranges. Also even though K=K1, the range values could be different.

There could be many cases like that.

I think we need to re-organize the data once this is collected. This organizing phase may require post processing data by looking at all the years. One of the easiset way is to use an IDE with an Agent and asking it to reformat the data based on a common schema. This needs to be thought through.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Labels

help wantedExtra attention is needed

Type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions