Replace content with fixed, deduplicated architecture. - #8
croadfeldt wants to merge 59 commits into
Conversation
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…, layers, sovereignty controls. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…e model, posture groups, compliance domain groups Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…ability. Signed-off-by: Chris Roadfeldt <[email protected]>
…h level, concurrent rehydration, discovered state retention. Signed-off-by: Chris Roadfeldt <[email protected]>
… deployment bootstrap info. Signed-off-by: Chris Roadfeldt <[email protected]>
…alidat, policy review, governance, grouping, relationship role validation, information providers. Signed-off-by: Chris Roadfeldt <[email protected]>
…tion, commit log capacity, system initiated records, distributed hash chains. Signed-off-by: Chris Roadfeldt <[email protected]>
…on metadata, operational analysis. Signed-off-by: Chris Roadfeldt <[email protected]>
…nty pre-filter, audit provenance, universal groups, information providers. Signed-off-by: Chris Roadfeldt <[email protected]>
…vice Providers vs producers Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…ovider. Added capabilities static content. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…ification pipeline, and final gap closure Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
… Enforcer, search index, admin api spec. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…, Provider, Policy Signed-off-by: Chris Roadfeldt <[email protected]>
…ers, fix ai prompt to remove confusion on orchestration, consolidate orchestration into policies, give examples. Signed-off-by: Chris Roadfeldt <[email protected]>
…ownership to accomodate for cluster as a service. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…ocumentation / specs. Signed-off-by: Chris Roadfeldt <[email protected]>
…andling depedencies better, health endpoints. Signed-off-by: Chris Roadfeldt <[email protected]>
…cy run applied. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…project, added some details on who,what,why,etc.. Signed-off-by: Chris Roadfeldt <[email protected]>
… 15 specs, 4 OpenAPI) Addresses all PR dcm-project#7 review comments: - Eliminated duplicate data-model directories - Fixed all broken cross-references - Removed 116 duplicate files - Updated provider count (12), policy count (8), classification enum (8) - Synced all OpenAPI YAMLs with canonical schemas Signed-off-by: Chris Roadfeldt <[email protected]>
eaac276 to
baa746b
Compare
There was a problem hiding this comment.
why is this file numbered while other in the folder are not?
There was a problem hiding this comment.
why were all the enhancements files removed? Is it because in the index there is already a link to the enhancement repo? Or because they were scattered in other places?
| → Fetches dc-us-east-1.yaml Core Layer from GitLab | ||
| → Fetches vm-standard service layer | ||
| → Merges: consumer fields + core layer + service layer + provenance map | ||
| → Publishes assembled payload to Kafka → dcm-policy-engine |
There was a problem hiding this comment.
So the only reason we need Kafka is for dcm-request-processor-> dcm-policy-engine communication?
| → dcm-provider-vm receives DCM VirtualMachine payload | ||
|
|
||
| 7. dcm-provider-vm naturalizes and executes | ||
| → Translates DCM VirtualMachine → AAP Job Template parameters |
There was a problem hiding this comment.
My guess is that there will be a lot of providers that implement AAP. This is an example of how a provider might be implemented.
| 8. dcm-provider-vm denaturalizes and callbacks | ||
| → AAP job completes → provider polls AAP for result | ||
| → Translates AAP job result → DCM VirtualMachine realized state | ||
| → POST /api/v1/provider/entities/{entity_uuid}/status to dcm-api-gateway |
There was a problem hiding this comment.
So we are not interested in status updates? Or why there is so many ways of sending status?
| ``` | ||
|
|
||
| **Talking points:** | ||
| - Intent State is immutable and stored in GitLab — survives the DC loss |
There was a problem hiding this comment.
In above you use API to communicate with DCM, but you say the intent is stored in gitlab? So user is not using git to manage it's infra but API, which is creating a commits in git?
There was a problem hiding this comment.
This should be cleaned up. The intent was to have incoming requests via Git. The use of git internally has been removed and consolidated.
| | Level | Required Endpoints | Unlocks | | ||
| |-------|-------------------|---------| | ||
| | **Level 1** | POST /api/v1/resources, GET /health, callback on completion | Basic provisioning and decommission | | ||
| | **Level 2** | + GET /discover, GET /capacity, PATCH /api/v1/resources/{id} | Discovery, drift detection, updates | |
There was a problem hiding this comment.
If I understand your architecture correctly, you are here missing the most important thing, which is something like /info. This should provide you name of the networks,storage,images,etc. Which will be used during mutation phase of the policy execution. Otherwise how can you have those fields in DCM, by hardcoding policies? IMHO that's unmaintainable.
| Network Port (no deps) ──────────────────────────┐ | ||
| ▼ | ||
| VM (depends on: Network Port) ────────────────▶ App Deployment complete | ||
| OCP Cluster (independent, parallel with VM) ──┘ |
There was a problem hiding this comment.
How do you define the dependencies between those? depends_on is not enough, it's says what depends on what, but it doesn't say WHY. That's what is most imporant, because based on WHY you can construct the graph. WHY VM depends on Network Port? What it needs? How do I use it? How do I specify it? Where?
| ├── requested.yaml | ||
| ├── assembly-provenance.yaml | ||
| ├── placement.yaml | ||
| └── dependencies.yaml |
There was a problem hiding this comment.
How VM could have dependencies, if it's just one resource? What's content of dependencies.yaml?
| ├── system/ | ||
| │ ├── core/ | ||
| │ │ ├── datacenter-layer.yaml | ||
| │ │ └── environment-layer.yaml |
There was a problem hiding this comment.
How do you keep those files in sync with real providers data?
|
|
||
| --- | ||
|
|
||
| ## 3. Example 1 — VM Provision End-to-End |
There was a problem hiding this comment.
Can you please show three-tier app, so we see how the three tier app is defined and the dependecies between the app? Like backend needs IP of database at least.
…in localized repos. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…olicy modifications are checked by policies, OPA policy templating, re-enforce policy triggers based on data, removed needless complexity, internal secrets handling, addressed prior PR comments. Signed-off-by: Chris Roadfeldt <[email protected]>
…/ architecture testing. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
…rns as a Service Provider. Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Signed-off-by: Chris Roadfeldt <[email protected]>
Closes PR #7 — this PR replaces the content from PR #7 with the complete, fixed architecture documentation. All review comments from PR #7 are addressed:
Issues fixed from PR #7
data-model/andarchitecture/data-model/directories → eliminated. Onlyarchitecture/data-model/exists now (55 docs with number prefixes).foundations.mdduplicating00-foundations.md) → removed. 53 slug duplicates eliminated.dcm-operator-sdk-api.mdWhat changed vs PR #7
Content structure