[BUG - Data] Unneccessary must run interconnector csvs

[louispt1]

Bug Description

Currently there are 96 csv files across datasets in ETSource that specify the must-run interconnector base curves which are (all) flat curves with values of 3.170979198376513e-08.
(3.170979198376513e-08 87603600 = 1)

---

Type of Data Issue

What type of data issue is this?
Select all that apply:

• Data Quality
• Data Integrity
• Data Processing
• Data Loading
• Data Validation
• Data Transformation
• Data Export
• Other

---

Impact

This setup wastes space and adds additional database overhead, increase maintenance and cost memory/processing as the curves are loaded and processed even though they don't really include any useful or meaningful data.

---

Suggested solution

We could have a method to generate a flat distributed profile in Qernel::Causality::Curves (or wherever the curves module lives) that can be defined and re-used in various adapters to handle this kind of case.

  def flat_profile
    Merit::Curve.new(Array.new(8760, 1.0 / (8760 * 3600)))
  end

We could then implement that method in the adapters:
export_consumer_adapter:

def consumption_profile
  @context.curves.flat_profile
end

import_always_on_adapter:

def production_profile
  @context.curves.flat_profile
end

This could allow us to remove the 96 extraneous csvs, and simplify the data flow. I don't think initial_updates should be necessary here, because when the curves aren't provided the coupling is not active, but we would have to check as they may be required for the graph to build properly.

[github-actions]

This issue has had no activity for 60 days and will be closed in 7 days. Removing the "Stale" label or posting a comment will prevent it from being closed automatically. You can also add the "Pinned" label to ensure it isn't marked as stale in the future.

[noracato]

I understand the problem, and I agree all these flat csvs are not the solution.

However, it could be more clear to ETSource users to specify this in Atlas.

So instead of

merit.group = interconnector_1_export_must_run

We would have

merit.group = flat

But that might even not be clear enough for our ETSourcers..