Usage Problem Add_value_provider_argument On A Streaming Stream ( Apache Beam /python)

We want to create a custom dataflow template using the function parameters add_value_provider_argument unable to launch the following command without inputting the variables define

Solution 1:

If you don't specify --input_topic when creating the pipeline, it will be of type RuntimeValueProvider, meaning you can only get() its value when the Dataflow job is running. This is normal.

Some transforms like WriteToBigQuery accept ValueProvider arguments (without the .get()). However, ReadFromPubSub does not currently accept ValueProvider arguments since it is implemented as a native transform in Dataflow.

See this documentation for more on creating templates with ValueProviders: https://cloud.google.com/dataflow/docs/guides/templates/creating-templates