Webhook validation fails

[andrii2020]

Webhook validation fails

Hi! I'm trying to add validation to the webhook. When I'm trying to use a key, timestamp, a payload from your GitHub file with tests everything works fine. But when I generate my own key and try to use the request body which I catch via webhook.site it fails. I can provide body, key, headers which I use. I have the last version of SendGrid installed.
Could you please check if newly generated keys works fine for you. Thanks!

Steps to Reproduce

1. Enable webhook in the admin panel
2. Enable validation
3. Add webhook.site link and send test request
4. Substitute received request and send it to my webhook
5. Receive fail because of bad key

[thinkingserious]

Hello @andrii2020,

One item to check is to make sure you are using the payload in raw bytes form.

Yes, providing sample data that we can use to reproduce would be helpful.

Thank you!

With best regards,

Elmer

[andrii2020]

Verification Key:
MFkwEwYHKoZIzj0CAQYIKoZIzj0DAQcDQgAEpWnjbw+pEuD8lTRd0aLycMT6AYQfx1GqxXQkDQtb0UsncIxsDxCRl9LYYv/p8dwZuEww7nPpUvR+F8W6ZItXjw==

x-twilio-email-event-webhook-signature
MEQCIHQkjRdbcbM/gXxai4eTHRDxsa6XyiIfXrqD6tBV7FUDAiAPZQSdHQU9O4Q/U9xA1wiDb8SppEgQbilr/Sb7sI5zCQ==

x-twilio-email-event-webhook-timestamp
1604746997

[{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"processed","category":["cat facts"],"sg_event_id":"Pi4uHYgstmIdRi-ZdO_ggg==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"deferred","category":["cat facts"],"sg_event_id":"bdD_tns7-PP42T7wi8JjBA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","response":"400 try again later","attempt":"5"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"delivered","category":["cat facts"],"sg_event_id":"RMmLFTkThVMMNSTUwe7ONA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","response":"250 OK"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"open","category":["cat facts"],"sg_event_id":"MBG5Xzl4mFtYaNnsffsZZA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","useragent":"Mozilla/4.0 (compatible; MSIE 6.1; Windows XP; .NET CLR 1.1.4322; .NET CLR 2.0.50727)","ip":"255.255.255.255"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"click","category":["cat facts"],"sg_event_id":"Flzg2OEW2UQIzsW1bSBNSA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","useragent":"Mozilla/4.0 (compatible; MSIE 6.1; Windows XP; .NET CLR 1.1.4322; .NET CLR 2.0.50727)","ip":"255.255.255.255","url":"http://www.sendgrid.com/"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"bounce","category":["cat facts"],"sg_event_id":"1IHdcZbI0LDWGHEw4kTSAA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","reason":"500 unknown recipient","status":"5.0.0"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"dropped","category":["cat facts"],"sg_event_id":"bgV-x0kIOFi1Koufqs72cA==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","reason":"Bounced Address","status":"5.0.0"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"spamreport","category":["cat facts"],"sg_event_id":"NBuZRGBjepr_LQFooZxC7g==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"unsubscribe","category":["cat facts"],"sg_event_id":"kiEES_suFldvMlepvYA7Xg==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0"},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"group_unsubscribe","category":["cat facts"],"sg_event_id":"wNf0IuGAVoAsmihEU-FBHw==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","useragent":"Mozilla/4.0 (compatible; MSIE 6.1; Windows XP; .NET CLR 1.1.4322; .NET CLR 2.0.50727)","ip":"255.255.255.255","url":"http://www.sendgrid.com/","asm_group_id":10},
{"email":"example@test.com","timestamp":1604746997,"smtp-id":"\u003c14c5d75ce93.dfd.64b469@ismtpd-555\u003e","event":"group_resubscribe","category":["cat facts"],"sg_event_id":"dxIWjlfzpye4b3zqaKSuKw==","sg_message_id":"14c5d75ce93.dfd.64b469.filter0001.16648.5515E0B88.0","useragent":"Mozilla/4.0 (compatible; MSIE 6.1; Windows XP; .NET CLR 1.1.4322; .NET CLR 2.0.50727)","ip":"255.255.255.255","url":"http://www.sendgrid.com/","asm_group_id":10}]

[thinkingserious]

Another thing to check is that you are including a trailing carriage return and newline.

[andrii2020]

Yeah, everything works fine with data from your tests. but when I substitute data which I shared previously it fails.

[eshanholtz]

I'm able to reproduce the failure you're seeing with the data you shared. This issue has been added to our internal backlog to be prioritized. Pull requests and +1s on the issue summary will help it move up the backlog.

[fmaillet24]

+1
exactly the same error with exactly the same setup.
It works with your test file, but not with webhook.site

[AntovskiAntonio]

+1
I have the exact same problem. I've also tried to add the trailing carriage return and newline, as suggested by @thinkingserious, but that didn't help either. Any suggestion on how to make this work?

[nawar]

Any resolution on this?

[shwetha-manvinkurke]

Have you all tried with a trailing \r\n after every event? Here is an example in node