Skip to content

Conversation

@tusharchou
Copy link
Owner

@tusharchou tusharchou commented Nov 4, 2024

Screenshot 2024-11-04 at 7 25 18 PM

Name: pytest for bigquery
About: Implement a test for class source bigquery
title: ''
labels: ''
assignees: ''


Is your pull request related to a issue? Please tag.

Describe the solution you have implemented
Describe the solution you have implemented

I implemented a test for the source_bigquery class using pytest. This includes covering various scenarios to ensure the class behaves as expected with different inputs and configurations.

Describe why alternatives you considered are not optimal

Using unittest was considered, but pytest was chosen for its concise and readable syntax, making the tests easier to maintain and understand.

Additional context

The tests were conducted against a mock BigQuery setup to ensure they can be executed in a local environment without needing access to an actual BigQuery instance.

Here's a screenshot of the test results:

tusharchou and others added 25 commits October 30, 2024 19:09
* Create publish.yml

* Update publish.yml
* Create publish.yml

* Update publish.yml

* Update publish.yml
* Update publish.yml

* Update publish.yml

* Update publish.yml
* Update publish.yml

* Update publish.yml

* Update publish.yml

* Update publish.yml

updated yaml file to copy distribution o/p from build to root directory

* Update publish.yml

added detailed copy from /ldf/dist to gihub/wo../dist

---------

Co-authored-by: Tushar Choudhary <[email protected]>
* Update publish.yml

* Update publish.yml

* Update publish.yml

* Update publish.yml

updated yaml file to copy distribution o/p from build to root directory

* Update publish.yml

added detailed copy from /ldf/dist to gihub/wo../dist

* Update publish.yml

added a code for creating dist directory

---------

Co-authored-by: Tushar Choudhary <[email protected]>
* Update publish.yml

* Update publish.yml

* Update publish.yml

* Update publish.yml

updated yaml file to copy distribution o/p from build to root directory

* Update publish.yml

added detailed copy from /ldf/dist to gihub/wo../dist

* Update publish.yml

added a code for creating dist directory

* Update publish.yml

relocating dots from ./github to /.github

---------

Co-authored-by: Tushar Choudhary <[email protected]>
* Update publish.yml

* Update pyproject.toml
* Update publish.yml

* Update pyproject.toml

* Update publish.yml
* Release v1.1 dist changes

* Release v1.1 publish.yml changes

* Release v1.1 publish.yml changes
@tusharchou tusharchou self-assigned this Nov 4, 2024
@tusharchou tusharchou added the good first review Good for newcomers label Nov 4, 2024
Copy link
Owner Author

@tusharchou tusharchou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

todo

  • add following to git ignore
  • .whl
  • .zip
  • .gz

* Release v1.1 dist changes

* Release v1.1 publish.yml changes

* Release v1.1 publish.yml changes

* Release v1.1
@mrutunjay-kinagi
Copy link
Collaborator

@tusharchou Please resolve this conflict.
Run the following commands :

  1. git fetch origin
  2. git switch main
  3. git pull
  4. git switch <branch_with_conflict>
  5. git merge main
  6. Resolve conflicts and commit

def __init__(self, name: str, path: Path = os.getcwd()):
self.name = name
self.path = path
self.path = os.getcwd()+path
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why you have taken os.getcwd() twice, once as argument and other time concatenating ?
pls check

mrutunjay-kinagi and others added 5 commits November 9, 2024 17:28
* fixed bug warehouse uri

Thu Oct 24 9:25 PM IST

* added logging to CSV.get()

* supported big query ts format

* refactored parameter to config from catalog to reduce confusion

* Fixed bug of logger in GCP

* replaced local path with dynamic path

* replaced local path with dynamic path

* replaced local path with dynamic path

* demo

* demo

* Release v1.1 dist changes

* Release v1.1 publish.yml changes

* Release v1.1 publish.yml changes

* added a class implementation for github issue hoping it is useful for guiding users to resolution ETAs eventually

* added a exception for PlanNotFound to ask users to raise issues on the repository for resolution

* Updated overview and milestones. Added directory structure under technical specifications.

* Updated components in technical speciifcations

* added testing for BigQueryToCSV.extract()

* added testing for BigQueryToCSV.extract()

* added testing for Iceberg.get()

* Release v1.1

* Release v1.1 bug fix

* Release v1.1 bug fix

* Release v1.1 bug fix

* Pytest Added for BigQuery Source

---------

Co-authored-by: Tushar Choudhary <[email protected]>
* feat(dx): Add Makefile and setup guide

* feat: Stabilize build and enhance developer experience

- Fixes dependency issues by correcting pyproject.toml and standardizing on a root requirements.txt for Read the Docs.
- Adds a Makefile to streamline common development commands.
- Introduces Dockerfiles for reproducible development and documentation hosting.
- Implements a script to dynamically generate a list of open GitHub issues for the documentation.
- Cleans up the project structure by removing obsolete Sphinx files, duplicate Makefiles, and misplaced source files.

* Add docs improvements, recipes, test, and CI workflow

* Remove site/ assets from version control and add to .gitignore

* docs: add wiki to docs and update mkdocs navigation

* Refactor: move package to root, update docs, fix navigation and developer tooling

* cleaning

* fix: update readthedocs.yml and docs improvements

* deleted readthedocs.yml

* added more docs

* added more docs

* added letter

* feat(library): introduce github module and src layout

* reset

* issues

* issues fix

* homepage

* business solutions

* marketing data analysis

* marketing data analysis fix

* marketing data analysis final
@tusharchou tusharchou closed this Dec 21, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment