Source: https://cloud.google.com/dataproc/docs/tutorials/bigquery-connector-spark-example#pyspark

Step Snap 1: [Jar version]

For non-production use, you can also point to the latest jars, as follows:

  1. Dataproc image version 1.5+-jars=gs://spark-lib/bigquery/spark-bigquery-latest_2.12.jar
  2. Dataproc image versions 1.4 and earlier: -jars=gs://spark-lib/bigquery/spark-bigquery-latest.jar

Non-production and latest would always be partners, lol.