Wait for fetch response to continue in for loop. Javascript Nodejs

Question

I have a function that connect to a web service in SOAP. Unfortunately the web service only support a very limited connections. I have an array of items to search in the web service, if i do a for or a foreach loop, the 70% of cases complete with no error, but in the 30% the web service response a error. This occurs when the max connections is overflow. This happens because the loop is no waiting the response of the webservice and the loop cotinues creating a lot of connections.

Here's my code:

var promiseArray = [];

for (var i = 0; i < result.length; i++) {

  let m = result[i].id
  let xml = '<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:tem="http://tempuri.org/">' +
    '<soapenv:Header/>' +
    '<soapenv:Body>' +
    '<tem:EjecutarConsultaXML>' +
    '<!--Optional:-->' +
    '<tem:pvstrxmlParametros>' +
    '<![CDATA[' +
    '<Consulta><NombreConexion>USERNAME</NombreConexion>' +
    '<IdConsulta>QUERY</IdConsulta>' +
    '<Parametros>' +
    '<doc>' + m + '</doc>' +
    '</Parametros>' +
    '</Consulta>' +
    ']]>' +
    '</tem:pvstrxmlParametros>' +
    '</tem:EjecutarConsultaXML>' +
    '</soapenv:Body>' +
    '</soapenv:Envelope>';

  const options = {
    explicitArray: true
  };


  promiseArray.push(new Promise(async(resolve, reject) => {
    await axios.post(url, xml, {
        headers: {
          'Content-Type': 'text/xml;charset=UTF-8'
        }
      })
      .then((data) => {
        xml2js.parseString(data.data, options, (err, result) => {
          var temp = (result['soap:Envelope']['soap:Body'][0]['EjecutarConsultaXMLResponse'][0]['EjecutarConsultaXMLResult'][0]['diffgr:diffgram'][0]['NewDataSet'][0]['Resultado'])
          resolve({
            doc: m,
            state: temp[0].f430_ind_estado[0]
          })
        });
      })
      .catch((err) => {
        console.log(err)
      });
  }))

}


res.send(await Promise.all(promiseArray))

Randy Casburn · Accepted Answer · 2021-02-17 23:15:29Z

1

There are several issues with your code within the call to promiseArray.push().

There is no need to create a new Promise() since axios already provides one
- This is actually and antipattern
There is no need for async/await in that call for the same reason.
Mixing Promises and functions that use callbacks usually doesn't turn out too well
You have no error checking in your code if the XML parser fails
The option object is not required as explicitArray: true is the default

Changes:

Removed all the extra/uneeded Promise code
Replaced xml2js.parseString with xml2js.parseStringPromise
Changed resolve to return
Since you're simply console.log() the error, removed unecessary boilerplate

Everything else is OK as written. Please let me know if I've missed something.

promiseArray.push(
  axios.post(url, xml, {
    headers: {
      'Content-Type': 'text/xml;charset=UTF-8'
    }
  })
  .then(data=>data.data)
  .then(xml2js.parseStringPromise)
  .then(result => {
    var temp = result['soap:Envelope']['soap:Body'][0]['EjecutarConsultaXMLResponse'][0]['EjecutarConsultaXMLResult'][0]['diffgr:diffgram'][0]['NewDataSet'][0]['Resultado'];
    return {
      doc: m,
      state: temp[0].f430_ind_estado[0]
    };
  });
  .catch(console.log)
);

answered Feb 17, 2021 at 23:15

Randy Casburn

14.2k1 gold badge19 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Mateo Buitrago Over a year ago

It works, but i need to put an "await" in the axios.post, because i receveid this Promise { <pending> }, , but with the await works great.

hoangdv · Accepted Answer · 2021-02-18 01:15:31Z

Just do it one by one, using async/await to do that, this means you have to use parseStringPromise instead.

var response = [];

for (var i = 0; i < result.length; i++) {
  let m = result[i].id
  let xml = '<soapenv:Envelope xmlns:soapenv="http://schemas.xmlsoap.org/soap/envelope/" xmlns:tem="http://tempuri.org/">' +
    '<soapenv:Header/>' +
    '<soapenv:Body>' +
    '<tem:EjecutarConsultaXML>' +
    '<!--Optional:-->' +
    '<tem:pvstrxmlParametros>' +
    '<![CDATA[' +
    '<Consulta><NombreConexion>USERNAME</NombreConexion>' +
    '<IdConsulta>QUERY</IdConsulta>' +
    '<Parametros>' +
    '<doc>' + m + '</doc>' +
    '</Parametros>' +
    '</Consulta>' +
    ']]>' +
    '</tem:pvstrxmlParametros>' +
    '</tem:EjecutarConsultaXML>' +
    '</soapenv:Body>' +
    '</soapenv:Envelope>';

  const options = {
    explicitArray: true
  };

  try {
    var { data } = await axios.post(url, xml, { // extract data from data.data
      headers: {
        'Content-Type': 'text/xml;charset=UTF-8'
      }
    })

    var xmlObject = await xml2js.parseStringPromise(data)
    var temp = (xmlObject['soap:Envelope']['soap:Body'][0]['EjecutarConsultaXMLResponse'][0]['EjecutarConsultaXMLResult'][0]['diffgr:diffgram'][0]['NewDataSet'][0]['Resultado'])

    response.push({
      doc: m,
      state: temp[0].f430_ind_estado[0]
    }) // push item to result array
  } catch (error) {
    console.log(error);
  }

}

res.send(result) // send the result to client

Collectives™ on Stack Overflow

Wait for fetch response to continue in for loop. Javascript Nodejs

2 Answers 2

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related