[Bug]: PySDK V3: pydantic-core (2.42.0) incompatibility with sagemaker.ai_registry dataset import

[ravees]

PySDK Version

• PySDK V3 (3.x)

Describe the bug
Fails with error below to import from sagemaker.ai_registry.dataset import DataSet
SystemError: The installed pydantic-core version (2.42.0) is incompatible with the current pydantic version, which requires 2.41.5. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.
To reproduce
Run the below code in SageMakerAI Studio notebooks

!pip install --force-reinstall sagemaker sagemaker-serve sagemaker-mlops sagemaker-train sagemaker-core
or
!pip install 'sagemaker>=3.0,<4.0' boto3 pydantic-core -q --force-reinstall --no-deps # failed

from sagemaker.ai_registry.dataset import DataSet

Expected behavior
Fails with error below to import from sagemaker.ai_registry.dataset import DataSet
SystemError: The installed pydantic-core version (2.42.0) is incompatible with the current pydantic version, which requires 2.41.5. If you encounter this error, make sure that you haven't upgraded pydantic-core manually.

Screenshots or logs
If applicable, add screenshots or logs to help explain your problem.

System information
A description of your system. Please provide:

• SageMaker Python SDK version: V3
• Framework name (eg. PyTorch) or algorithm (eg. KMeans):
• Framework version:
• Python version:
• CPU or GPU: SageMakerAI Studio notebooks
• Custom Docker image (Y/N): N

Additional context
Add any other context about the problem here.