MongoShardedPartitioner

最新推荐文章于 2025-07-18 16:16:26 发布

转载最新推荐文章于 2025-07-18 16:16:26 发布 · 355 阅读

1 ·

CC 4.0 BY-SA版权

原文链接：https://www.javadoc.io/doc/

文章标签：

#mongodb

MongoDB(Collenction-oriented) 专栏收录该内容

192 篇文章

订阅专栏

本文探讨了MongoDB与Spark RDD结合时的MongoShardedPartitioner类使用，该类继承自MongoPartitioner，用于按分片和块对集合进行分区。文章详细介绍了配置属性，如shardKey的作用及默认设置，并提供了实例构造器和成员值定义。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Class/Object

com.mongodb.spark.rdd.partitioner
MongoShardedPartitioner
Related Docs: object MongoShardedPartitioner | package partitioner
class MongoShardedPartitioner extends Logging with MongoPartitioner

The Sharded Partitioner

Partitions collections by shard and chunk.
Configuration Properties

The prefix when using sparkConf is: spark.mongodb.input.partitionerOptions followed by the property name:

shardKey, the shardKey for the collection. Defaults to _id.

Since

1.0

Linear Supertypes
Known Subclasses
Ordering

Alphabetic
By Inheritance

Inherited

MongoShardedPartitioner
MongoPartitioner
Serializable
Serializable
Logging
LoggingTrait
AnyRef
Any

Hide All
Show All

Visibility

Public
All

Instance Constructors

new MongoShardedPartitioner()

Value Members

def partitions(connector: MongoConnector, readConfig: ReadConfig, pipeline: Array[BsonDocument]): Array[MongoPartition]

Calculate the Partitions
val shardKeyProperty: String

The shardKey property