Argthtjtr

Case:
A file with over 1 mln records. Read the file and store records in Oracle DB.

Solution:
Use Hibernate statelessSession interface since there is no need to use persistence context in this particular case. Load records from file in a while loop 100k every time and commit them immediately.

Implementation:
At the top I have a method loadAllDictionaries() annotated with @Transactional with a timeout of 7200.
It starts a chain of methods and get to the while loop:

while(!(recordList = loadIDictionariesPackage(reader)).isEmpty()){

            processRecords(recordList, dictionaryVersion, dictionaryType, filename);

        }

Now, processRecords(...) does some stuff and at some point invokes the following(notice the propagation)

@Transactional(propagation = Propagation.REQUIRES_NEW, timeout = 900) //timeout is unnecessary since it takes around 2,5 minutes.  

public void saveInStatelessSession(List<T> entities) throws HibernateException {

    StatelessSession session = this.getSessionFactory().openStatelessSession();

    session.beginTransaction();



    entities.forEach(entity -> session.insert(getEntityName(), entity));



    session.getTransaction().commit();

    session.close();

}

So, after the while loop is finished and over 1 mln records are stored in DB the flow returns to loadAllDictionaries() method and enters another @Transactional method addNewLog(...)

@Transactional

public void addNewLog(AbstractLogEntry message) {



    final EventLogDefinition definition = logEntryDAO.getDefinitionForEntry(message);



    doAddNewLog(message, definition, null);

}

Here getDefinitionForEntry() throws an exception

com.atomikos.datasource.ResourceException: XA resource 'dataSource': resume for XID '3139322E3136382E35362E312E746D313534323739343839373335343033363332:3139322E3136382E35362E312E746D33373939' raised -4: the supplied XID is invalid for this XA resource

Now, whats strange. It only occurs if ~200k or more records are saved. It doesn't matter If I change the batch from 100k to 10k which increases the number of transactions. I thought it might be the atomicos timeout but in my app context file it is set to 3000

<bean id="atomikosUserTransaction" class="com.atomikos.icatch.jta.J2eeUserTransaction" depends-on="userTransactionService">

    <property name="transactionTimeout" value="3000" />

</bean>

If I delete the line

@Transactional(propagation = Propagation.REQUIRES_NEW, timeout = 900)

from saveInStatelessSession method than when loadAllDictionaries() transaction tries to commit the data I get

ERROR org.springframework.transaction.UnexpectedRollbackException: JTA transaction unexpectedly rolled back (maybe due to a timeout); nested exception is javax.transaction.RollbackException: Prepare: NO vote

Do you have any thoughts on what might be the issue here?