{"id":6836,"date":"2019-04-25T00:36:37","date_gmt":"2019-04-25T04:36:37","guid":{"rendered":"https:\/\/www.jitendrazaa.com\/blog\/?p=6836"},"modified":"2019-05-06T08:16:58","modified_gmt":"2019-05-06T12:16:58","slug":"framework-to-fix-governor-limit-of-100-jobs-in-flex-queue","status":"publish","type":"post","link":"https:\/\/www.jitendrazaa.com\/blog\/salesforce\/framework-to-fix-governor-limit-of-100-jobs-in-flex-queue\/","title":{"rendered":"Framework to fix – Governor Limit of 100 jobs in Flex Queue"},"content":{"rendered":"\n

Recently , I inherited an Org with huge customization , which enqueue 100+ Batch Jobs in few scenario. Now, don’t ask me why ? <\/p>\n\n\n\n

I remember, few years back, Salesforce had limit of 5 Apex Batch that can be executed at a time, but we had expectation and demand !!! Salesforce introduced Flex queue and we can have 100 Batch apex waiting to be executed, still we are not happy. After all, human is wanting animal. <\/p>\n\n\n\n

After 100 Batch apex, all jobs were failing with error System.AsyncException You have exceeded the limit of 100 Jobs in the flex queue. <\/strong>As I explained my life previously in this post<\/a>, I had to fix this issue as well.<\/p>\n\n\n\n

Right way to fix it was to analyze existing code, perform code review, why do we need even customization etc.. However, time was crucial and I had to do something quickly. <\/p>\n\n\n\n

Below framework was used to fix the issue<\/p>\n\n\n\n\n\n\n\n

  1. Create a Custom Object to hold information about batch<\/li>
  2. Use an intermediate Apex class to queue Batch Apex and Queueable Apex. If there is no availability in Flex queue then simply dump it in custom object.<\/li>
  3. Use a Scheduler which will run every 10 mins, check Flex queue and submit batches from Custom object if limit available<\/li><\/ol>\n\n\n\n
    \"Async
    Async Queue Framework in Salesforce to address governor limits<\/figcaption><\/figure>\n\n\n\n

    As you can see in below code, syntax to submit batch Apex is almost similar. <\/p>\n\n\n\n

    Instead of<\/p>\n\n\n

    \nID batchprocessid = Database.executeBatch(batchApexInstance,200);\n<\/pre><\/div>\n\n\n
    we would be using<\/p>\n\n\n
    \nID batchprocessid = AsyncApexFramework.submitBatch(batchApexInstance,batchSize,Prioity,isRetry);\nAsyncApexFramework.flush(); \n<\/pre><\/div>\n\n\n
    Where , <\/p>\n\n\n\n
    • @Param 1 – Instance of Batch Apex<\/li>
    • @Param 2 – Batch Size \/ Scope Size<\/li>
    • @Param 3 – Priority to process if there are many job in Queue. If null then default would be 99 <\/li>
    • @Param 4 – if Batch Apex has error, should it be retried again ? Use this option carefully , make sure your design does not negatively impact if same Batch runs multiple time<\/li><\/ul>\n\n\n\n
      Same way , instead of using <\/p>\n\n\n
      \nId jobId = System.enqueueJob(queueableClassInstance)\n<\/pre><\/div>\n\n\n
      We would be using <\/p>\n\n\n
      \nId jobId = AsyncApexFramework.submitQueueable(queueableClassInstance,priority,isRetry);\n\nAsyncApexFramework.flush();\n<\/pre><\/div>\n\n\n
      Where, <\/p>\n\n\n\n
      • @Param 1 – Instance of Queueable class<\/li>
      • @Param 2 – Priority to process if there are many job in Queue. If null then default would be 99 
        @Param 3 – if Batch Apex has error, should it be retried again ? Use this option carefully , make sure your design does not negatively impact if same Batch runs multiple time<\/li><\/ul>\n\n\n\n
        Below sample code, shows how we can add 300+ job in single transaction using this framework<\/p>\n\n\n
        \n\/\/Code snippet to submit Batch and Queuable\nfor(Integer i = 0; i<300;i++){\n    BatchDemo b = new BatchDemo('#B'); \n\tAsyncApexFramework.submitBatch(b,1,99,true);\n    AsyncApexFramework.submitQueueable(new QueueableDemo(),99,true);\n}\nAsyncApexFramework.flush(); \n<\/pre><\/div>\n\n\n
        \"Custom
        Custom Object AsyncQueue__c<\/figcaption><\/figure>\n\n\n\n
        Feel free to add your feedback and findings on this. <\/p>\n\n\n\n
        Source Code of Framework : <\/h3>\n\n\n\n