问题描述
我正在尝试使用MLCP将一百万个文档从一个数据库复制到另一个数据库，但是我正在关注Exception.
I am trying to copy 1 million documents from one database to another database using MLCP but I am getting following Exception.
19/08/30 11:48:08 ERROR contentpump.DatabaseContentReader: RuntimeException reading /integration/test/88398921012548 :java.lang.RuntimeException: Could not buffer value as string
我不确定发生此异常的原因.
I am not sure about the reason of this exception.
请指导我了解原因.
带有我使用的所有选项的MLCP
mlcp copy -mode local -input_host 192.168.1.46 -input_port 9000 -input_username admin -input_password admin -input_database test -output_host localhost -output_port 8000 -output_username admin -output_password admin -output_database test
推荐答案
MLCP倾向于并行运行多个线程，但这可能导致源系统或目标系统资源不足.另外，您正在与目标数据库在同一主机上运行MLCP，它们也可能争夺资源.最好查看如果使用-thread_count 1降低MLCP会发生什么.从那里您可以再次扩大规模.
MLCP tends to run multiple threads in parallel, but that could cause source or target system to run out of resources. Also, you are running MLCP on the same host as the target database, they might compete for resources as well. It is probably best to see what happens if you pace down MLCP using -thread_count 1. From there you can scale up again.
还要注意MLCP内存消耗，您可能需要使用JVM_OPTS为它分配更多的内存.另请参阅: https://stackoverflow.com/a/54685758/918496
Also keep an eye on MLCP memory consumption, you might need to give it more memory using JVM_OPTS. See also: https://stackoverflow.com/a/54685758/918496
HTH！
这篇关于使用MLCP复制数据时发生异常的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持！