Skip to content

fixes for model builder#5631

Merged
rsareddy0329 merged 8 commits intoaws:masterfrom
rsareddy0329:model-builder-fixes
Mar 19, 2026
Merged

fixes for model builder#5631
rsareddy0329 merged 8 commits intoaws:masterfrom
rsareddy0329:model-builder-fixes

Conversation

@rsareddy0329
Copy link
Contributor

@rsareddy0329 rsareddy0329 commented Mar 15, 2026

Issue #, if available:

By submitting this pull request, I confirm that you can use, modify, copy, and redistribute this contribution, under the terms of your choice.

jjtowner and others added 4 commits March 12, 2026 21:31
…ix unit tests for nova model support

- env_vars: append recipe/nova config to existing env_vars instead of skipping
- integ test: verify both base IC and adapter IC creation for LORA models
- unit tests: add _is_nova_model mock to accommodate nova model support changes
"""

min_memory_required_in_mb: int
min_memory_required_in_mb: Optional[int] = Unassigned()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we update the engine to mark this as Optional ?

We can add a condition for this specific case

}

# Nova hosting configs per model (from Rhinestone modelDeployment.ts)
_NOVA_HOSTING_CONFIGS = {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this not available through Jumpstart ?

def test_deploy_from_training_job(self, training_job_name, endpoint_name, cleanup_endpoints):
"""Test deploying model from training job and adapter."""
from sagemaker.core.resources import TrainingJob
"""Test deploying model from training job.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can we add a test case for Nova ?

DescribeInferenceComponent returns empty ComputeResourceRequirements
for adapter ICs (created with BaseInferenceComponentName), but the
service model still marks MinMemoryRequiredInMb as required. Add a
REQUIRED_TO_OPTIONAL_OVERRIDES config in the codegen so re-running
shapes generation produces the correct Optional field.
nargokul
nargokul previously approved these changes Mar 18, 2026
@rsareddy0329 rsareddy0329 merged commit 3e1aef8 into aws:master Mar 19, 2026
27 of 38 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants