batch-processing 相关问题

我正在使用 Spring Batch 和 StaxEventItemReader 读取下面的 xml 文件 xml 文件示例：我正在使用 Spring Batch 来读取下面的 xml 文件 StaxEventItemReader xml 文件示例： <ArrayOfStoreTransaction CustomerID="C1"> <PurchaseHistory Type="purchase.001" Count="2"> <StoreTransaction> <CustomerID>C1</CustomerID> <CustomerAccount>C1A</CustomerAccount> </StoreTransaction> <StoreTransaction> <CustomerID>C1</CustomerID> <CustomerAccount>C1A</CustomerAccount> </StoreTransaction> </PurchaseHistory> <PurchaseHistory Type="purchase.002" Count="1"> <StoreTransaction> <CustomerID>S3</CustomerID> <CustomerAccount>S3A</CustomerAccount> </StoreTransaction> </PurchaseHistory> <PurchaseHistory Type="purchase.003" Count="2"> <StoreTransaction> <CustomerID>S3</CustomerID> <CustomerAccount>S3A</CustomerAccount> </StoreTransaction> <StoreTransaction> <CustomerID>S3</CustomerID> <CustomerAccount>S3A</CustomerAccount> </StoreTransaction> </PurchaseHistory> </ArrayOfStoreTransaction> 这也是我用于绑定 xml 的对象 @XmlRootElement(name = "PurchaseHistory") @XmlAccessorType(XmlAccessType.FIELD) @Data public class PurchaseHistoryList { @XmlAttribute(name = "Type") private String type; @XmlAttribute(name = "Count") private int count; @XmlElement(name = "StoreTransaction") private List<StoreTransaction> storeTransactions; } @XmlAccessorType(XmlAccessType.FIELD) @Data class StoreTransaction { @XmlElement(name = "CustomerID") private String customerID; @XmlElement(name = "CustomerAccount") private String customerAccount; } 这是我的配置类： @Configuration @EnableBatchProcessing public class BatchConfiguration { @Bean public Step reportStep(StepBuilderFactory stepBuilderFactory, PlatformTransactionManager platformTransactionManager, ItemStreamReader<PurchaseHistoryList> reportItemReader, ItemWriter<PurchaseHistoryList> reportItemWriter, @Value("${chunk.size}") Integer chunkSize) { return stepBuilderFactory.get("reportStep") .transactionManager(platformTransactionManager) .<PurchaseHistoryList, PurchaseHistoryList>chunk(chunkSize) .reader(reportItemReader) .writer(reportItemWriter) .build(); } @Bean public Job reportJob(JobBuilderFactory jobBuilderFactory, JobRepository jobRepository, Step reportStep) { return jobBuilderFactory.get("reportJob") .repository(jobRepository) .start(reportStep) .build(); } @Bean public Unmarshaller paymentUnmarshaller() { Jaxb2Marshaller marshaller = new Jaxb2Marshaller(); marshaller.setClassesToBeBound(PurchaseHistoryList.class); return marshaller; } @Bean @StepScope public ItemStreamReader<PurchaseHistoryList> reportItemReader(@Value("#{jobParameters[filePath]}") String filePath) { StaxEventItemReader<PurchaseHistoryList> reader = new StaxEventItemReader<>(); reader.setResource(new FileSystemResource(filePath)); reader.setFragmentRootElementName("PurchaseHistory"); reader.setUnmarshaller(paymentUnmarshaller()); return reader; } @Bean public ItemWriter<PurchaseHistoryList> reportItemWriter(PurchaseHistoryListRepository repository) { return new PurchaseHistoryListWriter(repository); } } 我想要的是将块应用到 StoreTransaction 对象列表上。例如，如果块大小设置为 1，则提供给编写器的每个 PurchasingHistoryList 在每次迭代中应仅包含一个 StoreTransaction 对象。那是不可能的。您将一项定义为 PurchaseHistory XML 元素，其中可能包含一个或多个 StoreTransaction 元素。块大小应用于外部项目（而不是嵌套项目）。

spring spring-boot spring-batch batch-processing

回答 1 投票 0

Spring 批处理分区器：如何将 reader 类扩展为 bean 并在配置类中引用它

这是我的配置类， @豆 @StepScope 公共 JdbcPagingItemReader pagingItemReader( @Value("#{stepExecutionContext['fromRow']}")

spring-boot spring-batch batch-processing spring-batch-tasklet spring-batch-job-monitoring

回答 1 投票 0

CoreData 使用额外键批量插入（Cocoa 错误 1605。）

我正在使用 CoreData 将表示对象的字典数组 ([[String: Any]]) 插入到持久存储中。插入对象时，出现错误“操作无法完成”。 (

ios swift core-data batch-processing nsmanagedobjectcontext

回答 1 投票 0

awk 中的并行处理？

awk 逐行处理文件。假设每行操作不依赖于其他行，有没有办法让 awk 一次并行处理多行？还有其他文字吗