What WooCommerce already does for reviews
WooCommerce has product reviews built in and they are perfectly good for reviews left on your own store. What they cannot show is a review someone left on Google, Amazon or Etsy.
If that covers what you need, use it. This is for the case where your reviews are spread across platforms your site cannot see.
The one thing to know about WooCommerce
Product page templates vary enormously between WooCommerce themes, so a block added to one template may not appear where you expect on another. Check on an actual product page rather than in the editor.
Where reviews belong in a WooCommerce site
In the product description tab, under the add-to-cart area, or on the shop landing page. Shortcodes work if your theme supports them in product tabs.
Full-width sections suit carousel and grid layouts; sidebars and narrow columns suit a badge. Floating badges can be restricted to particular pages and to desktop or mobile.
Star ratings in Google search results
WooCommerce is the case where review markup does what people hope. The widget outputs Product schema with an AggregateRating, and Product is the type Google still shows star ratings for — the full explanation is here.
A product page carrying a star rating and a review count in the search result gets clicked more than the same page without one.