Skip to content

feat: Feast Operator example with Postgres in TLS mode. #5028

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 13 commits into from
Feb 25, 2025
Merged

feat: Feast Operator example with Postgres in TLS mode. #5028

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
13 commits
Select commit Hold shift + click to select a range
5242d95
rough working instructions to set up postgres in TLS mode and setting…
lokeshrangineni Feb 6, 2025
4b75e78
adding the example of postgres tls setup and deploying feast using po…
lokeshrangineni Feb 17, 2025
fe47fd2
deleting the files which are not needed.
lokeshrangineni Feb 17, 2025
806aede
uncommenting the code to uninstall the feast operator.
lokeshrangineni Feb 17, 2025
fadbbf4
Added the postgres example to the examples README.md index.
lokeshrangineni Feb 17, 2025
9b47b4b
Adding more details related to volumes and volumeMounts. and also inc…
lokeshrangineni Feb 17, 2025
f9a24eb
Removed the demo jupyter notebook which is not adding a lot of value.…
lokeshrangineni Feb 17, 2025
70e5fb5
Minor fixes.
lokeshrangineni Feb 17, 2025
bd990be
Minor fixes.
lokeshrangineni Feb 17, 2025
6725e53
Minor fixes.
lokeshrangineni Feb 17, 2025
05339cf
Minor fixes.
lokeshrangineni Feb 17, 2025
2b96077
Modified the examples README.md to make it more readable.
lokeshrangineni Feb 25, 2025
704f098
Adding the helm chart version to ensure it also works in the future.
lokeshrangineni Feb 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Minor fixes. 
Signed-off-by: lrangine <[email protected]>
  • Loading branch information
@lokeshrangineni
lokeshrangineni committed Feb 17, 2025
commit 70e5fb55b79d0d8a0a319ba1f9dba8d098064544
86 changes: 48 additions & 38 deletions examples/operator-postgres-tls-demo/02-Install-feast.ipynb
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@
},
{
"cell_type": "code",
"execution_count": 9,
"execution_count": 17,
"metadata": {
"scrolled": true
},
Expand Down Expand Up @@ -148,7 +148,7 @@
},
{
"cell_type": "code",
"execution_count": 11,
"execution_count": 26,
"metadata": {},
"outputs": [
{
Expand All @@ -175,28 +175,28 @@
},
{
"cell_type": "code",
"execution_count": 12,
"execution_count": 31,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"deployment.apps/feast-sample-db-ssl condition met\n",
"NAME READY STATUS RESTARTS AGE\n",
"pod/feast-sample-db-ssl-5ffc48c774-f6hpg 1/1 Running 0 39s\n",
"pod/postgresql-0 1/1 Running 0 13h\n",
"NAME READY STATUS RESTARTS AGE\n",
"pod/feast-sample-db-ssl-86b47d54-hclb9 1/1 Running 0 27s\n",
"pod/postgresql-0 1/1 Running 0 13h\n",
"\n",
"NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE\n",
"service/feast-sample-db-ssl-online ClusterIP 10.96.158.78 <none> 80/TCP 39s\n",
"service/postgresql ClusterIP 10.96.228.3 <none> 5432/TCP 13h\n",
"service/postgresql-hl ClusterIP None <none> 5432/TCP 13h\n",
"NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE\n",
"service/feast-sample-db-ssl-online ClusterIP 10.96.61.65 <none> 80/TCP 27s\n",
"service/postgresql ClusterIP 10.96.228.3 <none> 5432/TCP 13h\n",
"service/postgresql-hl ClusterIP None <none> 5432/TCP 13h\n",
"\n",
"NAME READY UP-TO-DATE AVAILABLE AGE\n",
"deployment.apps/feast-sample-db-ssl 1/1 1 1 39s\n",
"deployment.apps/feast-sample-db-ssl 1/1 1 1 27s\n",
"\n",
"NAME DESIRED CURRENT READY AGE\n",
"replicaset.apps/feast-sample-db-ssl-5ffc48c774 1 1 1 39s\n",
"NAME DESIRED CURRENT READY AGE\n",
"replicaset.apps/feast-sample-db-ssl-86b47d54 1 1 1 27s\n",
"\n",
"NAME READY AGE\n",
"statefulset.apps/postgresql 1/1 13h\n"
Expand All @@ -217,15 +217,15 @@
},
{
"cell_type": "code",
"execution_count": 8,
"execution_count": 32,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"NAME STATUS AGE\n",
"sample-db-ssl Ready 52s\n"
"sample-db-ssl Ready 33s\n"
]
}
],
Expand All @@ -242,30 +242,32 @@
},
{
"cell_type": "code",
"execution_count": 13,
"execution_count": 33,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Defaulted container \"postgresql\" out of: postgresql, init-chmod-data (init)\n",
" List of relations\n",
" Schema | Name | Type | Owner \n",
"--------+-------------------------+-------+-------\n",
" public | data_sources | table | admin\n",
" public | entities | table | admin\n",
" public | feast_metadata | table | admin\n",
" public | feature_services | table | admin\n",
" public | feature_views | table | admin\n",
" public | managed_infra | table | admin\n",
" public | on_demand_feature_views | table | admin\n",
" public | permissions | table | admin\n",
" public | projects | table | admin\n",
" public | saved_datasets | table | admin\n",
" public | stream_feature_views | table | admin\n",
" public | validation_references | table | admin\n",
"(12 rows)\n",
" List of relations\n",
" Schema | Name | Type | Owner \n",
"--------+------------------------------------------------------+-------+-------\n",
" public | data_sources | table | admin\n",
" public | entities | table | admin\n",
" public | feast_metadata | table | admin\n",
" public | feature_services | table | admin\n",
" public | feature_views | table | admin\n",
" public | managed_infra | table | admin\n",
" public | on_demand_feature_views | table | admin\n",
" public | permissions | table | admin\n",
" public | postgres_tls_sample_env_ca_driver_hourly_stats | table | admin\n",
" public | postgres_tls_sample_env_ca_driver_hourly_stats_fresh | table | admin\n",
" public | projects | table | admin\n",
" public | saved_datasets | table | admin\n",
" public | stream_feature_views | table | admin\n",
" public | validation_references | table | admin\n",
"(14 rows)\n",
"\n"
]
}
Expand All @@ -283,7 +285,7 @@
},
{
"cell_type": "code",
"execution_count": 14,
"execution_count": 34,
"metadata": {},
"outputs": [
{
Expand All @@ -302,7 +304,7 @@
" sslcert_path: /var/lib/postgresql/certs/tls.crt\n",
" sslkey_path: /var/lib/postgresql/certs/tls.key\n",
" sslmode: verify-full\n",
" sslrootcert_path: /var/lib/postgresql/certs/ca.crt\n",
" sslrootcert_path: system\n",
" user: ${POSTGRES_USER}\n",
"online_store:\n",
" type: postgres\n",
Expand All @@ -314,7 +316,7 @@
" sslcert_path: /var/lib/postgresql/certs/tls.crt\n",
" sslkey_path: /var/lib/postgresql/certs/tls.key\n",
" sslmode: verify-full\n",
" sslrootcert_path: /var/lib/postgresql/certs/ca.crt\n",
" sslrootcert_path: system\n",
" user: ${POSTGRES_USER}\n",
"registry:\n",
" path: postgresql+psycopg://${POSTGRES_USER}:${POSTGRES_PASSWORD}@${POSTGRES_HOST}:5432/${POSTGRES_DB}?sslmode=verify-full&sslrootcert=system&sslcert=/var/lib/postgresql/certs/tls.crt&sslkey=/var/lib/postgresql/certs/tls.key\n",
Expand All @@ -332,11 +334,19 @@
" DUMMY_ENTITY = Entity(\n",
"/feast-data/postgres_tls_sample_env_ca/feature_repo/example_repo.py:27: DeprecationWarning: Entity value_type will be mandatory in the next release. Please specify a value_type for entity 'driver'.\n",
" driver = Entity(name=\"driver\", join_keys=[\"driver_id\"])\n",
"/opt/app-root/src/sdk/python/feast/entity.py:173: DeprecationWarning: Entity value_type will be mandatory in the next release. Please specify a value_type for entity 'driver'.\n",
" entity = cls(\n",
"/opt/app-root/src/sdk/python/feast/entity.py:173: DeprecationWarning: Entity value_type will be mandatory in the next release. Please specify a value_type for entity '__dummy'.\n",
" entity = cls(\n",
"Applying changes for project postgres_tls_sample_env_ca\n",
"/opt/app-root/src/sdk/python/feast/entity.py:173: DeprecationWarning: Entity value_type will be mandatory in the next release. Please specify a value_type for entity 'driver'.\n",
" entity = cls(\n",
"/opt/app-root/src/sdk/python/feast/entity.py:173: DeprecationWarning: Entity value_type will be mandatory in the next release. Please specify a value_type for entity '__dummy'.\n",
" entity = cls(\n",
"/opt/app-root/src/sdk/python/feast/feature_store.py:579: RuntimeWarning: On demand feature view is an experimental feature. This API is stable, but the functionality does not scale well for offline retrieval\n",
" warnings.warn(\n",
"Deploying infrastructure for driver_hourly_stats_fresh\n",
"Deploying infrastructure for driver_hourly_stats\n",
"Deploying infrastructure for driver_hourly_stats_fresh\n",
" Feast apply is completed. You can go to next step.\n"
]
}
Expand All @@ -356,7 +366,7 @@
},
{
"cell_type": "code",
"execution_count": 15,
"execution_count": 35,
"metadata": {},
"outputs": [
{
Expand Down Expand Up @@ -404,7 +414,7 @@
},
{
"cell_type": "code",
"execution_count": 16,
"execution_count": 36,
"metadata": {},
"outputs": [
{
Expand Down
2 changes: 1 addition & 1 deletion infra/feast-operator/config/samples/v1alpha1_featurestore_postgres_tls_volumes_ca_env.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,7 @@ stringData:
sslmode: verify-full
sslkey_path: /var/lib/postgresql/certs/tls.key
sslcert_path: /var/lib/postgresql/certs/tls.crt
sslrootcert_path: /var/lib/postgresql/certs/ca.crt
sslrootcert_path: system
---
apiVersion: feast.dev/v1alpha1
kind: FeatureStore
Expand Down
Loading