aforeman
2021-03-29 22:11
@sidhant.bhayana.15 this the blog post Matt is referring to https://pactflow.io/blog/bi-directional-contracts/
aforeman
2021-04-22 08:09
*Live now* Ask Me Anything about Pact for those in the UK / EU region >> join here https://meet.google.com/zkk-iadv-ujr for the next 20 mins
aforeman
2021-05-18 07:36
It's A-MAY time! :sweat_smile:
:thinking_face: Got a question about contract testing?
:thinking_face: Trying to figure out how to deploy to production without running hours of slow, flakey integration tests?
:thinking_face: Keen to get our team's thoughts on testing complex microservices and APIs?
Hit attend:point_down: to join us, live, to have your questions answered!
APAC
Thurs 27 May 2021
12:00PM - 12:30PM AEST
Join :point_right: https://lnkd.in/gE4cnHS
UK / EU
Thurs 27 May 2021
9:00AM - 9:30AM BST / 8:00AM - 8:30AM CEST
Join :point_right: https://lnkd.in/gEQbnyS
North America
Thurs 27 May 2021
6:30PM - 7:00PM EDT / 3:30PM - 4:00PM PDT
Join :point_right: https://lnkd.in/gQiPHCX
zaxosdimi
2021-05-26 14:34
Hello all,
I have the following questions for the tomorrow session https://lnkd.in/gEQbnyS
What are the Pact best-practices to:
1) trigger the provider's verification flow, right after the contract is published from consumer to Pactflow (maybe using webhooks)?
2) manage pacts for different environments (e.g. dev, stage, production)? Should use tags or different integrations with suffix, e.g. ProviderDev, ProivderStage, etc?
3) run pact tests inside gitlab-ci pipelines?
4) do you suggest to use pact testing for development environment too, or is it most used for staging/production?
Thank you very much for your time!
Best Regards,
Zacharias Dimitrakoudis
aforeman
2021-05-27 04:18
If you missed our first May Ask Me Anything, catch the recording https://www.youtube.com/watch?v=97UA4E8RPCU&t=771s.
Got a question? Post below for one of the following upcoming events:
We'll be online again in T-4 hours (https://www.linkedin.com/events/contracttesting-askmeanything-d6793435525052272640/) and T-16 hours (https://www.linkedin.com/events/contracttesting-askmeanything-d6793432710179368960/)
:bananadance:
aforeman
2021-05-27 08:26
Re-watch the UK/Europe AMA here https://www.youtube.com/watch?v=VNozekxXf5g
(links to docs shown will be added to the video description shortly).
aforeman
2021-05-27 22:13
We are live now for our third and final May AMA for the next ~30 minutes. Please join us >> https://youtu.be/TWDxWXH595s
(Or visit this link later to catch up on anything you missed!)
aubilla
2021-06-01 09:30
I?m super interested in the answers to these questions. Is there a recording of the AMA?
aubilla
2021-06-01 09:31
Nevermind, found it! https://www.youtube.com/watch?v=97UA4E8RPCU&t=771s&ab_channel=Pactflow
2021-06-02 01:11
@aforeman has a polly for you!
aforeman
2021-06-03 00:58
We're booked the June AMA dates/times - see https://www.linkedin.com/company/pactflow/events/?viewAsMember=true (and add to your calendar).
Got a question to table? Ask here :smile:
aforeman
2021-06-22 11:00
:wave: A reminder that the *June AMAs are locked in for next week*
Find a suitable date / time https://www.linkedin.com/posts/pactflow_contracttesting-pactflow-pact-activity-6812986600117678082-0gAJ (and add to your calendar. We'd love to have you drop in and ask your question to the Pactflow product team (who are also all core maintainers of Pact :slightly_smiling_face:)
Pop your questions in this thread :point_down: in advance or ask them live via the event chat.
Hope to catch you there!
aforeman
2021-06-28 08:12
*The agendas for tomorrow's AMAs have been announced over on the event pages:*
_*June AMA #1 - with @bethskurrie and @matt.fellows*_
? Recommended if you're based in *North America or like early mornings in APAC ?*
? See the time/date (in your local timezone) and get access to the link to join https://pactflow.us4.list-manage.com/track/click?u=d975bc32fd84ad3580ed4777e&id=745f61a440&e=c8512beabb
_*June AMA #2 - with @uglyog and @matt.fellows*_
? Recommended if you're based in the *UK/Europe or prefer an evening drop in for APAC*
? See the time/date (in your local timezone) and get access to the link to join https://pactflow.us4.list-manage.com/track/click?u=d975bc32fd84ad3580ed4777e&id=73d3abd7a7&e=c8512beabb
Got a question of your own? Post it in this channel.
Hope to see you there!
aforeman
2021-06-28 22:06
We're live for the next ~25 mins - please jump on and ask any questions you may have! https://www.youtube.com/watch?v=VnOy9Sv9Opo
matt.fellows
2021-06-28 23:10
Recording is up: https://www.youtube.com/watch?v=VnOy9Sv9Opo
*We covered:*
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=140s - How does Pending Pacts work?
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=645s - How does WIP Pacts work?
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=1050s - Understanding webhooks - how they work, the event cycle and debugging them
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=1465s - (audience question) Can users be synced with Google? Can users be part of multiple teams?
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=1500s - (audience question) Should we have multiple brokers (e.g. 1 per project) or is this something the Teams feature addresses?
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=1630s - (audience question) How does Pact work with IoT solutions?
* https://www.youtube.com/watch?v=VnOy9Sv9Opo&t=1650s - (audience question) What are the SLAs for Pactflow SaaS? Are there enterprise options?
aforeman
2021-06-29 08:07
We're back for round two - join us live for the next ~25 mins https://www.youtube.com/watch?v=u7LzZ6Fm1Ok
matt.fellows
2021-06-29 08:38
We covered:
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=120s - What?s in store for Pact Specification v4.0?
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=753s - Can you use Pact to test GraphQL APIs?
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=1125s - How do I know when I have the right contract-testing coverage?
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=1375s (audience question): When introducing a new interface, what comes first - the consumer or the provider?
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=1500s (audience question): How to extract the resulting pact files from pact-ref-mock-server?
* https://www.youtube.com/watch?v=u7LzZ6Fm1Ok&t=1558s (audience question): Do you recommended to include in contract tests query string filters, pagination, etc.? Or are theses general features we take for granted that should be covered by unit tests only?
aforeman
2021-07-21 23:10
Excited to share we have a special topic to discuss and a new guest joining for our July AMA!
@tjones ?Pact OSS Core Maintainer?will join @matt.fellows and @bethskurrie to discuss all things schema testing.
About Tim:
_Tim is an independent consultant specialising in cloud delivery in legacy environments, writing software you can reason about, and drinking tea. Tim has worked with OpenAPI specs in enterprise environments enough times to get burned and make mistakes and is keen to share those mistakes so that you can avoid them too._
---
Get all the info, including link to join, here :point_right:https://lnkd.in/gRDwbWv
---
As always, please share your questions in advance via the LinkedIn event or in this channel.
Hope to see you there! And if you can't make it, table your question in advance and we will answer it and share the recording!
dsmileb
2021-07-26 16:11
Hello! Could you assist me please? Our backend team have pushed for attention the contract testing approach. Our backend generates the pact contracts first and asks the frontend side to test them. I have investigated the http://pact.io docs and as far as i have understood we cant use the pact for the approach. Probably, it means our project has the producer-driven testing approach. Could someone help me, please? Is it possible to test the pact files from the backend side on the frontend. We have an Angular framework with Jest.
Thanks
matt.fellows
2021-07-27 00:41
I?m not sure what you?re asking here.
> Our backend generates the pact contracts first and asks the frontend side to test them
This doesn?t make sense, Pact is a consumer-driven framework and contracts are generated by consumer tests. The pacts are then verified by providers.
There is a feature called https://docs.pactflow.io/docs/workshops/bi-directional/ that supports a provider-driven workflow, where a provider uploads their OAS file and the consumer publishes a pact file.
dsmileb
2021-07-27 10:39
Our backend generates the pact files to separate repo. I dont understand how we need to integrate the Pact to test the separated Pact files from backend on the frontend side.
Is it possible to do?
matt.fellows
2021-07-27 11:26
It doesn't work this way, have you read anything about Pact? I'd suggest watching the videos and reading the http://docs.pact.io https://m.youtube.com/playlist?list=PLwy9Bnco-IpfZ72VQ7hce8GicVZs7nm0i
dsmileb
2021-07-27 13:59
Yeah, I have been reading the docs during this week. I will try to assure my team to choose this approach.
However, does the approach that i described above has the name? I would like to investigate more pros/cons to assure the team.
dsmileb
2021-07-27 20:44
As far as I understand our backend generates pact files from spring cloud contracts. They ask the frontend team to pull these pact files (for example as a separate npm-package with these jsons) and test them using the `const provider = new Pact({...}` instance along with our Angular HTTP services. I have read the Pact docs and understand this is something wrong. Also, I can't find anything similar on the internet about this approach.
Is it possible to use the Pact on the frontend side in the situation when the backend drives the API and generates the pact contracts?
matt.fellows
2021-07-28 01:59
As stated previously, Pact does not work this way.
1. Consumer generates pact file (by writing pact tests)
2. Consumer publishes pact to broker
3. Consumer shares pact file to provider
4. Provider verifies pacts from its consumers (discovered via the broker)
matt.fellows
2021-07-28 01:59
you?re talking about a provider-driven workflow, which Pact doesn?t support
matt.fellows
2021-07-28 02:00
one option is to take the pact files generated by the provider and use them as https://docs.pact.io/getting_started/stubs/ for consumer tests. If you _only_ use those to mock provider behaviour and all of your consumer tests pass, this might give you more confidence
matt.fellows
2021-07-28 03:29
:wave: Tomorrow?s AMA we are joined by @tjones and we are going to talk all things schemas, specifications and contracts. If you?ve ever asked the question ?Can I just generate my contracts from an <OpenAPI spec/JSON Schema/?>? then this session is for you.
Really looking forward to it.
We?ll cover:
Questions we will cover:
- What are schemas, specifications and contracts?
- What are the benefits of each and what problems are they trying to solve?
- Do the concerns overlap (and is that a problem)?
- How can schemas be combined with contracts to get the most out of each?
- Integrating these practices with tools such as Postman
- Experiences / case studies (e.g. https://www.atlassian.com/engineering/spec-first-api-development) https://www.linkedin.com/events/contracttesting-askmeanything-s6823164725531148288/about/#
?And any questions that come along the way
Join here :point_right: https://www.linkedin.com/events/contracttesting-askmeanything-s6823164725531148288/
aforeman
2021-07-28 22:08
We're live now for the next ~25 minutes https://lnkd.in/g4Zw59K
Jump in to hear our discussion about schema testing with special guest, @tjones
The recording will be available on YouTube when we wrap up.
aforeman
2021-08-10 06:30
Hello!
Our August AMA is just around the corner and this month, we're very excited to have our friends from https://www.linkedin.com/company/2392223?Pactflow consulting partner based in Germany?joining us to discuss the topic 'contract testing with Avro".
Our guests are @kristine.jetzke ?CTO @ kreuzwerker?and @anja.gruss ?Engineering Consultant @ kreuzwerker who will be joined by familiar face, @matt.fellows ?Co-Founder of Pactflow.
It's free to attend to listen in or table questions for our speakers. Join here https://www.linkedin.com/events/contracttestingwithavroama-with6830641454193487872/ and be sure to add to your calendar.
If this time doesn't suit, hit attend so you can get access to the recording when it's available.
Please table any questions you have either on the event page or in this channel.
Hope to catch you there!
aforeman
2021-08-19 08:10
If you're around, please https://youtu.be/75uA3X2lVqo as @matt.fellows chats with @kristine.jetzke and @anja.gruss from our consulting partner, https://kreuzwerker.de/en, about *contract testing with Avro*.
And if you've missed it, the recording will be available for you to revisit anytime, on YouTube :grinning:
aforeman
2021-09-14 21:00
Hello! Our next contract testing AMA is locked in for the last week of September. This month we have *Bedford West, Head of Test Engineering at M1 Finance*, joining us. See the event info https://www.linkedin.com/events/contracttestingama-rollingoutpa6843394751811715072/.
M1 Finance is a US-based personal financial app providing customers with automated investing, borrowing and banking products. Bedford joined M1 Finance earlier this year to bring rigour around the company?s testing processes. In this short time, he?s devised and begun executing a test automation strategy, of which an important component is contract testing with Pactflow.
Bedford will join as for a structured Q&A about his experience implementing Pactflow at a fast-growing FinTech during a period of rapid growth and expansion.
We are also welcoming questions from the audience. Post any questions for Bedford in advance in this thread:point_down:. And, if the time isn't friendly, no stress :slightly_smiling_face: pose your question and we'll have it answered and share the recording with you post event.
Hope to see you there!
mike.geeves064
2021-09-14 23:14
Let's go for a couple of questions then:
? have you found a good approach to adding in pact tests to an existing set of software (it can be tricky for example even generating good example input/output in complicated flows to make pacts from once there is a service that's there, works, doesn't get touched much)
? have you managed to impact time spent running other types of test as a result? e.g. less e2e tests needed, or greater stability of tests being run
? finance can be a fairly slow moving manual domain, has pact so far been able to help with trusting a 'can-i-deploy' and not need to plan and schedule manual deployments?
? are you seeing benefits in speed of development etc yet, vs the overhead of rolling out additional tests to an already existing product, or is there still a way to go? (aka has it given early wins, or do you see this as a longer term benefit)
aforeman
2021-09-20 02:27
Thanks for this, @mike.geeves064 looking forward to tabling these questions next week with Bedford!
aforeman
2021-09-27 21:30
*September AMA: Rolling out Pactflow with M1 Finance*
Our September AMA is Tues evening (North America) / Wed morning (APAC) this week and we're excited to have@bedfordwest, Head of Test Engineering at M1 Finance, join us to talk about his journey adopting contract testing with Pactflow.
As a taster, hear Bedford share how he got started + tips for others new to contract testing, in https://youtu.be/kXUGqIHlbuk?t=1.
Be sure to hit attend on the https://www.linkedin.com/events/contracttestingama-rollingoutpa6843394751811715072/ to access the link to join the AMA and post any questions you have for Bedford in the thread :point_down:
Catch you soon!
aforeman
2021-09-28 22:06
Good morning or afternoon! Excited to have Bedford with us now for today's AMA! Join us now?we're live!
https://lnkd.in/ddFsDe_5
Table any questions you might have for Bedford and his experience rolling out contract testing with Pactflow in this thread :point_down:
mike.geeves064
2021-09-28 22:33
Except now I have that nagging feeling that maybe I should be trying to add in tests for existing code before trying to refactor everything :smile:
matt.fellows
2021-09-28 22:34
if you don?t have tests to tell you they?re broken, you can just plead ignorance
mike.geeves064
2021-09-28 22:36
Unfortunately I then have to answer to myself for breaking it and I can be quite grumpy :smile:
filipovic
2021-10-13 07:49
I?ve see in the pactflow website that it supports OpenAPI Schemas but couldn?t finde any document/screenshot that would explain/show this. Do you have any reference for me to look up?
matt.fellows
2021-10-13 07:55
Take a look at this: https://docs.pactflow.io/docs/workshops/bi-directional
aforeman
2021-10-19 07:00
Join us next week for our November AMA on the topic Test Strategy with guest @abubics
Andras will join us for a chat about about his recent SkillsMatter talk on using contract testing to speed up dev & deploy, and abolish end-to-end tests. We?ll cover topics such as:
> What is integration testing?
> Writing code for testability
> Utility of devices such as the testing pyramid to think about crafting a test strategy
> The benefits and drawbacks of contract testing
> Approaches to removing the need for end-to-end integrated testing
...and your questions (which you can post in this channel).
See the details https://www.linkedin.com/events/contracttestingama-teststrategy6853878053765046272/ and hit attend to keep up to date.
PS this event is friendly for those in APAC/UK/EU. If you're not in one of these timezones, the recording will be available on YouTube :tv:
j.malyjasiak
2021-10-25 14:42
Hello! We are currently considering various migration options from multiple internal pact brokers to a SaaS version of PactFlow. As of today the plan is to run both in parallel and send all the data (tags, pacts) to PactFlow and additionally ask for a possibility to get our databases dumps imported so that we have no gaps in data. Webhooks can be migrated at any point in time from our perspective (mostly terraform) and I?m more concerned about verification results (no idea how to migrate them seamlessly while still using existing pact brokers for verifications). Do you have any experience in putting pact broker behind a proxy to duplicate most of the traffic to PactFlow or backfilling historical data with db dumps? We find it quite crucial due to backward compatibility documented with some of the contracts. Thanks!
mike.geeves064
2021-10-25 17:21
You might be better off asking in #pactflow rather than here, the -ama (Ask Me Anything) channel is more towards the monthly AMA sessions than day-to-day issues, so it might be a month before anyone replies :joy:
matt.fellows
2021-10-26 01:42
We might have to do something custom for you Jakub. We can definitely import one broker but that's not going to work for you
j.malyjasiak
2021-10-26 05:46
Thanks @mike.geeves064 and @matt.fellows! I?ll post a reference to this thread on #pactflow to continue the discussion.
matt.fellows
2021-10-26 06:44
no worries. as I said, your case is a little more unusual so we?ll probably need to work closely with you. Any learnings of course we can look to share back to the wider community
aforeman
2021-10-26 09:18
Got a burning question about test strategy? Hit the link below to join tomorrow's AMA where we chat with https://www.linkedin.com/in/ACoAAB8LFkkBfnGY6ruiQ3NTn4r0P6dqxSF-8us about all things test strategy.
Andras is a Lead Consultant at DiUS and has worked with a bunch of technologies and stacks including embedded, hardware and IoT to VR, mobile, web and microservices as well as infra, dev-ops and CI/CD :sunglasses:
Join us to hear topics such as:
> What is integration testing?
> Writing code for testability
> Utility of devices such as the testing pyramid to think about crafting a test strategy
> The benefits and drawbacks of contract testing
> Approaches to removing the need for end-to-end integrated testing
Plus, table any of your own questions in this thread :point_down:
Hope you see you there :slightly_smiling_face: https://lnkd.in/gvCcTfxz
aforeman
2021-10-27 06:05
Are you free right now? Got a question about test strategy? We're live * now * - join us https://www.youtube.com/watch?v=zKbmpRbPYUg
Post any questions :point_down:
aforeman
2021-12-08 22:29
*Curious about the differences between Pactflow and the self-hosted Pact Broker?* This time tomorrow, Pactflow Co-Founders? @bethskurrie and @matt.fellows ?will be live on YouTube chatting about how to do contract testing with Pact and the differences between Pactflow and the self-hosted Pact Broker.
This final AMA for 2021 coincides with the newly released, inaugural Pactflow Contract Testing Report?so we'll cover some key findings from the report too. Download your copy here https://pactflow.io/pactflow-contract-testing-report-2021/ :tada:
So if you have a question, join us live tomorrow at 3pm PST / 9am AEST >> https://www.linkedin.com/events/contracttestingama-comparingpac6869498736658264064/about/ :bananadance:
Post any specific question you have in this thread :point_down: and we'll have them answered for you!
aforeman
2021-12-09 22:00
:wave: We are live! Join @matt.fellows @bethskurrie and I now over on YouTube https://www.youtube.com/watch?v=5LcW_8lgySs for the next 30 mins.
If you have a question about contract testing with Pact - using the self-hosted Pact Broker or Pactflow, drop it in the thread here or as a comment on the video. :party_parrot:
diva.pant1
2021-12-16 17:23
When we say Pactflow provides scalable and faster solution over Pact, in theory how does it do that specifically? Making it *faster and scalable*
matt.fellows
2021-12-16 21:17
Just noting this was answered in your other thread so others don't respond here not realising
charles.kuo
2022-02-10 21:46
I am encountering error when checking Pact's interactions under PactFlow
This happens to all Pact our company created
I was wondering if there is an email I can reach out to follow up on the issue?
Update: email sent to
ingcmurcia
2022-02-15 20:38
Hello, I have a question (and I don't know if this is the right place to ask it). if in my service architecture we are working with gRPC-protobuf, and the services (providers and consumers) consume the same proto files, this makes the protos the contract itself, rigth?... That said, *what would be the advantage of using PACT in this kind of architecture? (*taking into account that you are already working on supporting gRPC communication*)*
matt.fellows
2022-02-15 20:49
andrevdrodrigues
2022-03-08 13:01
Hello @matt.fellows how are you?
This https://pactflow.io/blog/the-case-for-contract-testing-protobufs-grpc-avro/ that you shared inform that pactflow isn't supported contract tests for grpc and protobuffs yet: "Whilst Pact doesn't (yet) currently officially support these technologies, we're currently building the plugin infrastructure in Pact to enable gRPC and Protobufs to be tested in this fashion."
However, is it the current state yet, or have we more news about it? And for avro? I saw a https://muirandy.wordpress.com/2022/03/03/contract-testing-with-pact-kafka-and-schema-registry-part-2/ related to contract avro implementation but I don't if it's already supported officially/
Thanks a lot!!!
andrevdrodrigues
2022-03-08 13:03
I already saw this information related to Kafka: https://docs.pact.io/recipes/kafka and this ticket regarding https://pact.canny.io/feature-requests/p/support-protobufs .
So, Im little bit confused regarding the official support for these features:
Avro
Protobufs
GRPC
Thanks :slightly_smiling_face:
yousafn
2022-04-19 17:39
Hi @b.1.alpha, have you read https://pactflow.io/blog/pactflow-joins-the-smartbear-family/ regarding the announcement, should hopefully help answer your questions
david.vancouvering
2022-04-19 17:45
Haha the question of the hour. I'll give you my thoughts. I looked at SmartBear. They do not appear to be some kind of Borg that will chew up Pact. They are already in the world of providing support for open source projects such as Cucumber and Swagger - and both those tools fit into the world of testing and APIs. So I am hopeful. Perhaps they can provide needed infrastructure for things like sales and marketing and IT so the Pact team can focus on features.
But an acquisition is always risky and I think we'll all need to keep an eye on things. What is our backup plan? This always needs to be part of the consideration when working with third parties.
For me I'm glad to know much of Pact is in open source, although SSO and bidirectional contracts are really important and would be missed.
matt.fellows
2022-04-19 22:46
This article that we penned a few years back is still highly relevant: https://pactflow.io/blog/why-build-an-open-source-company/
matt.fellows
2022-04-19 22:48
The system is setup such that if our commercial endeavour fails - maybe the market doesn?t like the product, we don?t deliver on our promises etc. - the OSS ecosystem will be there with open arms.
I don?t see this changing under SmartBear, given the two thriving communities mentioned above.
jean.paiva42
2022-04-27 19:00
Hi everyone, not sure if this is the right place to ask but does anyone know a pact implementation for salesforce apex language?
madhulika.mitra
2022-05-09 22:30
Hi Team - Reposting - https://pact-foundation.slack.com/archives/C9UTHV2AD/p1652135304487949
samikshaphulzele
2022-05-16 10:01
Hi Everyone, So we support pact with avro , if yes can somebody ping me pact example with avro schema registry, if no Do we have workaround to do contract testing with avro schema registry
james.weng
2022-05-17 05:33
Can you explain more on bidrectional testing and in which cases/scenarios we should consider them . What is the differences of bidrectional testing and traditional pact tests?
yousafn
2022-05-17 07:32
Hi @james.weng,
Have you read the https://docs.pactflow.io/docs/bi-directional-contract-testing#use-cases and https://docs.pactflow.io/docs/bi-directional-contract-testing#comparison-to-pact?
Is there a specific use case you want to expand or, is anything missing, or confusing?
We are also happy to refine the content so feedback is welcome!
james.weng
2022-05-18 03:52
Will give it a read. Thanks. WIll shoutout if i need any clarification! Thanks @yousafn
james.weng
2022-05-18 04:35
Just trying to understand more on can-we-deploy. When do we use it and how can we we use it if we are using pactflow?
2022-05-18 04:51
Here are a number of useful hands-on labs that teach all of the key concepts: https://docs.pactflow.io/docs/workshops and https://docs.pact.io/implementation_guides/workshops
james.weng
2022-05-18 06:36
Is there a simple way to invite users (eg allow or user of organisation to be able to login with user rights?)
matt.fellows
2022-05-18 06:37
https://docs.pactflow.io/docs/user-interface/settings/authentication
You can add Google or Github for SSO, or on our business plans add SAML2.0
yousafn
2022-05-18 13:12
No worries my friend, really happy to help refine the docs or build out more examples where needed
james.weng
2022-05-18 23:22
hi @matt.fellows thanks for this. I enabled google for sso and it works really great but i have a query re same emails. If i login same email from pactflow and also google sso it seems to be treating them as different users instead of unifying them?
james.weng
2022-05-18 23:33
is it via here? what should we put in the accepted github organisation box ? i tried airwallex and also http://airwallex.com but no joy
matt.fellows
2022-05-19 00:08
> hi @matt.fellows thanks for this. I enabled google for sso and it works really great but i have a query re same emails. If i login same email from pactflow and also google sso it seems to be treating them as different users instead of unifying them? (edited)
They are treated as different users at the moment. You can just disable the old ones when SSO is working as expected
james.weng
2022-05-23 02:50
Is there an updated link to the provider state documentation ?This link seems to be broken (http://docs.pact.io/documentation/provider_states.html)
Trying to link from: https://docs.pact.io/implementation_guides/jvm/provider/gradle
matt.fellows
2022-05-23 02:53
`command+k` (Mac) should open a search window for you (or head to the top-right hand of the page)
matt.fellows
2022-05-23 02:53
This is probably the page: https://docs.pact.io/getting_started/provider_states
yousafn
2022-05-23 11:59
Updated now, looks like this came up a few times in slack in the past, so have updated it now
https://github.com/pact-foundation/pact-jvm/pull/1558
yousafn
2022-05-23 12:00
will propagate through to the docs site in around 5/10 minutes when the builds copy the pact-jvm docs over
jean.paiva42
2022-06-14 02:31
Hey I am very new to pact and sorry for just be dropping messages like this here but I?ve been trying to use: https://www.rubydoc.info/gems/pact-provider-verifier/1.11.0#setting-a-custom-authentication-header
and while I do get to hit my endpoint and it seems like the expectations are actually running it seems like my provider is returning a body in a format different from what I am expecting, even though the content is what I intended?
I am expecting a json on the contract response but it seems like I am getting the provider response with `\` on each time a quote appear. Is there a way to deal with a situation like this, maybe treat the response before comparing them?
What I am expecting (example):
`{"foo":"bar"}`
what I am getting:
`{\"foo\":\"bar\"}`
Is this something I can fix with the pact-provider-verifier or I would need to fix with my provider?
matt.fellows
2022-06-14 04:41
is it possible that the JSON payload is being escaped by Ruby in the code that is reading the response?
matt.fellows
2022-06-14 04:41
This question might be best asked in #pact-ruby so the Ruby community can contribute to the chat
madhulika.mitra
2022-07-07 16:11
Hello :slightly_smiling_face: . We are trying to do some Bidirectional test with pactflow with our OAS. Now for certain negative cases, we want have pact tests with invalid request bodies which would in actual env simulate the errors. But when we do the schema check we get an error "Request body is incompatible", - is there a way for some cases we do not do a strict check on the request bodies?
ali.ustek
2022-08-01 17:16
Is there support for `AsyncApi` and/or Pulsar. if so, any examples?, if not, why not?
matt.fellows
2022-08-01 22:50
> Is there support for `AsyncApi` and/or Pulsar. if so, any examples?, if not, why not?
We don?t have any direct support for AsyncAPI, but you should be able to test pulsar using what is referred to as ?Message Pact?.
> . if so, any examples?, if not, why not?
well, one reason is it?s very hard to have an example for every combination of technology people want.
matt.fellows
2022-08-01 22:50
There are examples for Kafka, SNS and other messaging frameworks (howtoexamples)
ali.ustek
2022-08-02 09:57
I meant, why not support for AsyncApi? as I am evaluating bi-directional contract testing for a project
ali.ustek
2022-08-03 09:23
if there is anything I can help let me know, I'll what I can do make the process faster
wil.pannell
2022-10-16 17:03
:wave: Hi everyone!: I?m a long time back pactflow OSS subscriber and user.
How do I move my account and/or contracts to the new SmartBear platform?
nuno.frias
2022-11-22 10:09
Hi all,
I need to build contract tests for a microservice based system, where some of the microservices interact with external APIs both as consumers and providers.
For the interactions between "internal" microservices I am using classical Pact, but for the interactions with external APIs I am planning to use the new bidirectional contract testing approach as the documentation suggests it is better suited.
I was wondering if anyone else has ever attempted this mixed use of Pact and bidirectional contract testing , or whether you think it is better to stick with one.
matt.fellows
2022-11-22 11:18
You can definitely use them together. In fact, you can even have regular and BDCT contracts on the same integration point.
It?s worth noting that you?ll have decreased confidence for 3rd party providers - you?ll simply need to assume they actually implement the API.
Depending on the situation, that assumption might be invalid and it may also not matter. e.g.. would you _not_ deploy a consumer if the provider implementation in a particular environment changed in a backwards incompatible way (that is, it wasn?t compatible with the OAS you had)? In that case, likely your production system is broken in some form anyway, and now you can?t deploy a workaround.
The scenario I?m thinking of are 3rd parties, where there are no test environments and then a signoff from you (the partner) is required, so all you can go off is a single environment (essentially prod).
nuno.frias
2022-11-22 11:27
Most of our partners do publish OAS specs (afaik they have never been inaccurate) which we use together with their API docs to create mocks of their API's.
My thinking is that we can use their OAS specs for when the external API is a provider and we can assemble a consumer contract from our mock services following the example in the docs ( https://docs.pactflow.io/docs/bi-directional-contract-testing/contracts/pact#converting-mocks-into-a-pact-compatible-format) for when the external API is a consumer.
nuno.frias
2022-11-22 11:33
In principle our partners should alert us when they plan doing changes to their API if they break backwards compatibility and we should either have access to new specs or be able to create new ones.
nuno.frias
2022-11-22 11:35
So in principle we should not be faced with a situation like you described.
nuno.frias
2022-11-22 11:38
I think we should be able to verify wether our consumers are compatible with the new OAS in a test env.
simon.petty
2023-01-09 21:22
Hi. My company makes very heavy use of Kafka, and i?ve been interested recently in bi-directional contract testing. We use Avro schemas stored in a schema registry, so i?m aware that ours isn?t a particularly common use-case for Pact. I?ve seen this on the roadmap: https://github.com/pactflow/roadmap/issues/32, so i?m curious about how i *might* be able to help. I?m new to Pact so I imagine getting to grips with how this works for messaging systems now is the first step?
simon.petty
2023-01-09 21:27
Where one Kafka topic typically has many consumers - the producer registers an Avro schema for their topic, but consumers also tend to define their own, which is meant to be compatible but they only find this out at runtime. If there was some way for consumers to register their own schema (with perhaps stricter logical types), this could be used to drive two way contract validation (consumer schemas and producer schemas must be compatible with each other etc)
matt.fellows
2023-01-09 22:29
Supporting Avro in Pactflow via BDCT will first require support for AsyncAPI, and also support for another tool to generate a pact file with avro interactions in it.
@ali.ustek is currently investigating creating an Avro plugin for Pact, which would be one of the key components in a BDCT flow.
I?d suggest joining the #avro channel to see where that?s at and how you might be able to contribute to the development/requirements of that plugin
marcin.slowiak.007
2023-02-03 16:23
Hi there :slightly_smiling_face:
Recently I found the `bidirectional` testing option in your framework.
I have a question - what is the difference:
? using PactFlow bidirectional idea (verify vs OAS schema)
? creating mocks based on client with models generated from OAS
From my understanding, the only difference is that having bidirectional option with whole Pact tooling gives us ability to find consumers of specific OAS (from producer perspective).
Am I missing something?
matt.fellows
2023-02-06 00:01
well, that?s a big benefit.
You still get:
1. Visibility of the subset of surface area (APIs/data) your consumers use (endpoints, fields etc.)
2. Coordination - which versions of your consumers/providers are compatible at which point in time
3. Breaking change detection
You then of course get the remaining OAS benefits (code gen etc.)
Does that help? Perhaps you could go into a bit more detail about your needs/use case?
sugi
2023-02-13 10:13
Hi All, We are trialing out pactflow in our organisation. I have question regarding number of integrations available in started plan. With the starter plan 5 application integrations are allowed. I'm not sure which one is applicable. Would be great if someone can confirm this:
1. 5 different providers with each provider having n number of consumers?
2. 5 different provider & consumer combination
matt.fellows
2023-02-13 10:38
The way I think about it is this. It?s the number of different arrows on your architecture diagram. We allow up to 5 of the arrows.
So you can have 5 consumers of one provider (6 applications in total)
Or you can 5 pairs of completely different consumers and providers with no overlap (10 applications in total)
jrede
2023-02-23 18:41
Hey Pactflow, Does the https://github.com/pactflow/pact-cypress-adapter work on Cypress v10+ ?
matt.fellows
2023-02-24 03:07
We should add a compatibility table on the docs. I don?t know the answer to that though
shuying.lin
2023-02-24 03:21
Hello Jacob, the adapter supports cypress 10, some minor configuration updates are required. I'll raise a PR for it later
yousafn
2023-02-24 11:18
we took in pr to make it backwards compat with v7 and below back in sept
https://github.com/pactflow/pact-cypress-adapter/pull/17
thanks for the PR Shuying, will give it a spin today
yousafn
2023-02-24 13:29
@shuying.lin?s PR which shows how you can utilise the adapter for cypress 10.
https://github.com/pactflow/pact-cypress-adapter/pull/31
nicely done Shuying :+1:
eugene.malihins
2023-02-27 13:00
Looking for suggestions on how to deprecate fields in API / Provider Contract in Pactflow BDCT scenario.
Our FE app installs our API OAS and uses it to create request handlers for API, and we also use this installed OAS in FE with openapi-backend library to mock responses for MSW/pact-msw-adapter. We are now looking to remove some fields from the API OAS, and have already stopped FE app from using them.
Trouble is, the current OAS schema used for mock generation and consequently for pact-msw-adapter still has those fields, and the resulting Consumer Contract expects them to be present in OAS (Provider Contract). This means that a PR on the API OAS to remove these fields fails verification. Does anyone have any experience with handling this?
matt.fellows
2023-02-28 04:50
> we also use this installed OAS in FE with openapi-backend library to mock responses
I think that?s your problem. The consumer should reduce the number of fields expected in the mock, but if you?re using the supplied OAS as the source of the mocks you?re always going to get stuck in this loop.
Can the consumer not modify the mocks for their specific needs?
eugene.malihins
2023-03-01 12:01
thanks Matt, this helped clear up my understanding of the problem :+1: we're now running mock server with mocks created on Consumer side specifically for each endpoint and are able to deprecate Provider fields
jrede
2023-04-27 22:22
As our org is ramping up implemention into pactflow some of our services are missing the verification results which in turn raises a can-i-deploy error even if the contract is valid.
lori.maurais
2023-05-05 13:56
We are doing a pactflow POC, and I?d like to get a sanity check on what we?re attempting? we?d like to pilot bidirectional contract testing, and our services communicate via async messaging over (pulsar) queues.
lori.maurais
2023-05-05 13:56
Is this reasonable, and can you point me to any demos, messaging tutorials etc? Many Thanks!
matt.fellows
2023-05-05 23:36
Hi Lori, we don't yet support BDCT for messaging/ AsyncAPI, only RESTful APIs that can be described by OAS
It's on the roadmap for this year
https://github.com/pactflow/roadmap/projects/1
matt.fellows
2023-05-05 23:36
What protocol are you sending messages with on pulsar? E.g. Json, avro, protobufs
lori.maurais
2023-05-08 13:43
Hi Matt, thanks for a quick response, (even if it wasn?t what I was hoping to hear). Bummer! :scream: It looks like BDCT async is queued up for 4th quarter this year? We?re sending json over pulsar. Thanks!
matt.fellows
2023-05-08 23:34
Thanks for letting me know! I?ll pop down your use case against the feature.
In the mean time, you could still do regular Pact testing with Pulsar via our messaging support. What language do you use?
lori.maurais
2023-05-09 13:16
Good Morning, Matt. We?ve got one java system (the consumer - the one reading and responding to messages sent by the other) and a node/nest system is the producer. These are the two components we?re piloting. None of this is greenfield, and we do have oas specs, which are two of the reasons we were hoping to do BDCT.
lori.maurais
2023-05-09 14:47
If you can point me to anything that might be helpful with this architecture, I?d surely appreciate it. Thanks!
matt.fellows
2023-05-10 05:27
Interesting, how are you documenting Pulsar with OAS? Does pulsar support HTTP?
lori.maurais
2023-05-10 17:56
That?s a great question - we really aren?t, though we kept the document up to date. My understanding (and I?m a relative newbie on this project) is that the communication between the components was originally via http, not messaging. The switch came later. However, one of the components is still using the doc for codegen
matt.fellows
2023-05-10 22:15
To my knowledge, you can?t specify a messaging application in OAS (that?s the purpose of AsyncAPI). So if it is documented in an OAS, it wouldn?t adequately describe it
matt.fellows
2023-05-10 22:16
at least, it would be hard for a tooling maker to make assumptions about how it was (ab)used in order to make decisions about correctness etc.
lori.maurais
2023-05-10 22:20
Good Morning (at least over there - are you in Australia?) I?m guessing my best code examples for CDCT/messaging are going to be the java_kafka ones, is that correct?
lori.maurais
2023-05-11 13:07
Thanks - we?ve got java on the consumer side and node on the producer side
sagupta
2023-06-08 11:18
Hi , I am looking to do a POC for contract testing with pact on a Frontend (Legacy Python Pyramid app: consumer) and a microservice (Python API).
Because both consumer and provider are legacy apps, its not easy to bring them up locally to be able to perform consumer driven contract testing. So i read about Bi-directional contract testing where I can use the exisiting OpenAPi spec and a testing tool in provider side to create a contract and still implement contract testing workflow .
I still just want to ask this question to this group to validate if this is the path i can take forward or am i missing something here ? Appreciate your help
yousafn
2023-06-08 11:19
Yeah that is a suitable use case, but still contains the caveats that the comparisons will be against the schemas, and thusly the onus is on the provider team to ensure they have sufficient coverage on the openapi definition they present
sagupta
2023-06-22 11:39
Hello @yousafn I was able to present the approach to my team members and they have asked one question regarding using the consumer driven contract testing approach which i wanted to know your view also .
My colleague: If its difficult to bring up the service locally in a CI server , can we use the tests and run them against the Staging version of the service?
This way , pact tests can still tell us if the deployed version of the service on staging is compatible with the consumer or not and we can stop the deployment of that version to PROD.
My response: We can run it but we are then not checking if the change made to the service already breaks the consumer in a local version and prevents it from deploying to STAGING. We will know about such issues only in STAGING which is not early .
sagupta
2023-07-05 11:14
hi @yousafn just wanted to check if you can provide your insights into my question
yousafn
2023-07-05 12:58
your response is correct, you could perform the tests against the running and deployed service, but this is reactive rather than proactive.
by testing the providing service pre deployment you have confidence that the exposed routes will honour consumer expectations
yousafn
2023-07-05 12:59
it may be difficult to spin up the service locally, but this is something to consider as part of the testing approach. you may need to consider refactoring parts of your application to better support local running.
yousafn
2023-07-05 13:01
If i am in a team as a QA i would discuss the testing challenges and the problem we are trying to solve with contract testing. highlight the fact that this would be conducted largely as a development time exercise and as a QA i can get involved in the code review time rather than waiting for an application to be shipped.
this closer collab between the QA and dev teams can lead dev teams to understand and propose solutions to making an app _testable_ for your new contract testing use case
sagupta
2023-07-05 13:10
Awesome these are very helpful points . I will have a chat with my colleague about them for sure :+1:
matt.fellows
2023-07-10 22:33
That?s the point. It?s important to your consumer (by being in the contract) but not defined anywhere. Should it be defined or should it be removed from your consumer?
jrede
2023-07-10 22:42
got it, looks like our cypress adapter was automatically putting those headers on, need to update all our consumers now to ignore it
lori.maurais
2023-07-13 21:24
Hi All, I have a question about testing message based systems: with http consumer based testing, you start the provider service and have the ability to set state. With a message based system, is there still the ability to run the provider and set up state? All of the examples I?ve seen look like straight unit tests that don?t involve running the provider. I?m wondering if I?m missing something. Thanks!
matt.fellows
2023-07-13 21:46
That's right, otherwise we'd need to know how to talk to 1000 different message queue technologies
jrede
2023-07-25 04:42
Hey all, we have this validation error, however all the validators were running against say the OAS is valid.. How is this being determine / How can we perform this check locally to find the issue?
```"nullable" cannot be used without "type"```
matt.fellows
2023-07-25 06:52
matt.fellows
2023-07-25 06:53
TL;DR - add an explicity `type` on whatever property currently has `nullable` on it.
jrede
2023-07-26 21:47
Thanks for that, curious how I can suggest updating a field like so to account for a missing type, ex:
``` "answer": { "nullable": true, "oneOf": [{ "type": "object" }, { "type": "string" }] },```
david.hvilava
2023-08-08 11:05
Hello) My company uses PactFlow and now we're exploring bi-directional tests. Microservices of our product may have multiple API versions and in this case multiple OAS files are generated (we use Swagger).
Can PactFlow somehow handle different API versions of Provider if they are stored in separate docs? I tried uploading them one at a time, but they override each other. Thank you in advance.
yousafn
2023-08-08 11:13
Hey hey,
you need to merge them, its noted in the docs :+1:
https://docs.pactflow.io/docs/bi-directional-contract-testing/contracts/oas#document-limitations
yousafn
2023-08-08 12:06
np, I wonder if we could detect an unresolved ref and warn the user on upload, or post upload to make it indicative that it does needed merging
yousafn
2023-08-09 12:45
no worries, it?s easy when you know where to look, happy to share :slightly_smiling_face:
