Hello,

First of all, absolutley love nodebb! Keep up the amazingly good work. With that said I am a little stuck.

I am working on a plugin that can (will) process a stripe payment for each new post. I have created an end-point hook for stripe to let me know when payment transactions have been completed. The problem that I have is I can't figure out how to find a topic based on uid and a custom session ID that I was successfully able to attach to every new topic. Once I can identify the topic I would like to mark it as paid by updating a custom field. Any ideas?

I have looked into src/topics but I can't seem to figure out how to use any of the functions for what I am trying to do. I might be missing something a little bit more fundamental here.

Thank you in advance!

Avan

@julian

You got it.

@julian

The problem remains. Incoming data will will stay in json format. There is an alternative way of handling the stripe hook event that doesn't involve parsing it raw format but my understanding is that it is less secure way of handling the event. I will continue to look for a solution but it seems more and more like the only good solution is to introduce a new hook or move the current hook up.

@PitaJ said in Best way to add a json body-parser that comes before the root json body-parser in webserver.js:

middleware

@PitaJ

Yes I have tried that along with a few other things. No luck. Stripe wants it in raw format. The stackoverflow answer I shared has a solution where it changes the order of execution of the middleware. It was little too advanced for my taste. I am still hoping to attach my middleware a little more early on.

@julian

I definitely feel like I am missing something. In the code snippet I provided it uses the bodyParser.raw({type: 'application/json'} middleware. According to the official body-parser documentation:

"bodyParser.raw([options])
Returns middleware that parses all bodies as a Buffer and only looks at requests where the Content-Type header matches the type option. This parser supports automatic inflation of gzip and deflate encodings.

A new body object containing the parsed data is populated on the request object after the middleware (i.e. req.body). This will be a Buffer object of the body."

I don't need the data to be json but in raw(buffer) format. The incoming data is in json format but I need to parse it.

Thanks for responding @julian @PitaJ

Stripe requires the incoming data to be parsed to raw data.

Here is a snippet of their recommended method of handling incoming hook event data:

// ...
// Match the raw body to content type application/json
app.post('/webhook', bodyParser.raw({type: 'application/json'}), (request, response) => {
  const sig = request.headers['stripe-signature'];

  let event;

  try {
    event = stripe.webhooks.constructEvent(request.body, sig, endpointSecret);
  }
  catch (err) {
    response.status(400).send(`Webhook Error: ${err.message}`);
  }
// ...

It looks like the stripe event construction requires the incoming data to passed as raw data.

Here is the link to the documentation page: https://stripe.com/docs/webhooks/signatures

Like I said before I might be missing something. I am aware there was/is a stripe plugin already so I assume there is a way to handle this situation without the introduction of a new hook.

@julian said in Best Way to Add a bodyParser verify function:

static:app.load

Hey @julian

I am sorry if I am not clear but the problem is the order of execution of the body-parser middleware. The webserver.js body-parser comes before any body-parser I can attach. Does that make sense? I even I attach a new mount to router using the static:app.load hook I cannot change the order of execution. Nodebb will always process incoming json through the webserver.js first and last.

The only solution I personally see if to introduce a new hook that comes before the
static:app.preload hook. Currently setupExpressApp() which is where the json body-parser is being called comes before initializeNodeBB() which is where static:app.preload is fired up.

Maybe I am missing something else though.

@julian in case you are still interested. I realized I didn't provide my post with enough context or state what high level problem I am trying to solve. I am writing a private plugin that involves accepting stripe payments. In order to handle stripe event hooks correctly I need the incoming data to be in raw format hence the usage of body-parser. However I just couldn't figure out how to get around the json bodyparser in webserver.js. So after a long discussion on Stackoverflow somebody found a temporary hack. However we also came to the conclusion that it would be nice to have a hook that gets fired up even earlier than

static:app.preload

That way I can attach my middleware before the json parser in webserver. Am I missing another hook that I might be able to use? Or can you think of another way to resolve my issue that does not involve using the hack in the Stackoverflow answer?

Thank you.

How to get around previously declared json body-parser in Nodebb?

I am writing a private plugin for nodebb (open forum software). In the nodebb's webserver.js file there is a line that seems to be hogging all incoming json data. app.use(bodyParser.json(jsonOpts...

Stack Overflow (stackoverflow.com)

Hey @julian

Thanks for the quick reply. Not sure if I completely understand your suggestion. But I feel the fundamental problem remains: webserver.js is hogging parsing incoming data coming in as json? If I remove the

app.use(bodyParser.json(jsonOpts));

in webserver.js and add the following parsing code in my endpoint I can get it to work.

var rawBodySaver = function (req, res, buf, encoding) {
	  if (buf && buf.length) {
	    req.rawBody = buf.toString(encoding || 'utf8');
	  }
	}
	// //
	app.use(bodyParser.json({ verify: rawBodySaver }));

If I mount a route handler which to be honest I haven't looked into it yet and I don't know what it entails I feel like the fundamental problem of the webserver.js processing incoming data still remains, right?

I might be missing something even more fundamental.

Hey everyone,

I hope this is the right place post my question. I was wondering where and or how to add a body-parser verify function?

inside the configureBodyParser function in webserver.js there is

const jsonOpts = nconf.get('bodyParser:json') || {};
app.use(bodyParser.json(jsonOpts)); 

I am trying to add a verify key with a function as a value which I assume you would add to the config.js file? I am not quiet sure how to add a function for the value.

This all started with me trying to use app.use(bodyParser.json()) in a plugin but then I realized that if there is already one app.use(bodyParser.json()) somewhere else (webserver.js) that it will ignore any other ones that are declared afterwards?

Any help would be greatly appreciated.

Oh yeah, I should mention that my ultimate end goal is to convert the incoming body of one of the endpoints to raw format.