400 error on get_block() call

[julrach]

When I am making a client.get_block(full_url) call, I am getting the below:

Got 400 error attempting to POST to loadPageChunk, with data: {
    "pageId": "***",
    "limit": 100000,
    "cursor": {
        "stack": []
    },
    "chunkNumber": 0,
    "verticalColumns": false
 }

[ERROR] HTTPError: Invalid input.
Traceback (most recent call last):  
  File "/var/task/get_kitchens_function.py", line 15, in lambda_handler    
    page = client.get_block(full_url)  
  File "/opt/python/lib/python3.7/site-packages/notion/client.py", line 169, in get_block    
    block = self.get_record_data("block", block_id, force_refresh=force_refresh)  
  File "/opt/python/lib/python3.7/site-packages/notion/client.py", line 162, in get_record_data    
    return self._store.get(table, id, force_refresh=force_refresh)  
  File "/opt/python/lib/python3.7/site-packages/notion/store.py", line 184, in get    
    self.call_load_page_chunk(id)  
  File "/opt/python/lib/python3.7/site-packages/notion/store.py", line 286, in call_load_page_chunk    
    recordmap = self._client.post("loadPageChunk", data).json()["recordMap"]  
  File "/opt/python/lib/python3.7/site-packages/notion/client.py", line 262, in post    
    "message", "There was an error (400) submitting the request."

I didn't change anything in my code and this just started to happen. I suspected it was a token_V2 problem but just checked and it isn't. I saw #11 from back then and looks like there might be an API structural change.

Would love to hear all of your thoughts! Trying to get this resolved because a product of mine depends on this! Thank you!

[nissy131]

It seems that the Notion API has changed and a large limit get 400 error now.
I changed "limit": 100000 to "limit": 100 , and got 200.

[julrach]

It seems that the Notion API has changed and a large limit get 400 error now.
I changed "limit": 100000 to "limit": 100 , and got 200.

@nissy131 Ok so I need to do like client.get_block(full_url, limit=100) now?

[hellvesper]

It seems that the Notion API has changed and a large limit get 400 error now.
I changed "limit": 100000 to "limit": 100 , and got 200.

@nissy131 Ok so I need to do like client.get_block(full_url, limit=100) now?

I think you should do this in source

notion-py/notion/store.py

Line 280 in c9223c0

"limit": 100000,

Because this is hardcoded value

[julrach]

It seems that the Notion API has changed and a large limit get 400 error now.
I changed "limit": 100000 to "limit": 100 , and got 200.

@nissy131 Ok so I need to do like client.get_block(full_url, limit=100) now?

I think you should do this in source

notion-py/notion/store.py

Line 280 in c9223c0

"limit": 100000,

Because this is hardcoded value

Was just about to edit my reply. Probably could create a PR out of this. Is 100 the highest?

[danmcmahill]

Should this be a hard coded value or should there be a way to adjust early on in a program? And thanks for figuring this out. I hit the same thing with something that worked a few hours ago was no longer working.

[julrach]

Should this be a hard coded value or should there be a way to adjust early on in a program? And thanks for figuring this out. I hit the same thing with something that worked a few hours ago was no longer working.

I agree with this and also think that there is going to be a need for pagination as well since some things might have more than 100 blocks.

[nanpuhaha]

In my case...

Traceback (most recent call last):
  File "app.py", line 71, in <module>
    cvb = client.get_block(os.getenv('TABLE_URL'))
  File "/opt/hostedtoolcache/Python/3.8.8/x64/lib/python3.8/site-packages/notion/client.py", line 169, in get_block
    block = self.get_record_data("block", block_id, force_refresh=force_refresh)
  File "/opt/hostedtoolcache/Python/3.8.8/x64/lib/python3.8/site-packages/notion/client.py", line 162, in get_record_data
    return self._store.get(table, id, force_refresh=force_refresh)
  File "/opt/hostedtoolcache/Python/3.8.8/x64/lib/python3.8/site-packages/notion/store.py", line 184, in get
    self.call_load_page_chunk(id)
  File "/opt/hostedtoolcache/Python/3.8.8/x64/lib/python3.8/site-packages/notion/store.py", line 286, in call_load_page_chunk
    recordmap = self._client.post("loadPageChunk", data).json()["recordMap"]
  File "/opt/hostedtoolcache/Python/3.8.8/x64/lib/python3.8/site-packages/notion/client.py", line 260, in post
    raise HTTPError(
requests.exceptions.HTTPError: Invalid input.

[julrach]

Feel free to use #293 as a workaround for now.

[ttran]

from tzlocal import get_localzone

import notion
def call_load_page_chunk(self, page_id):

    if self._client.in_transaction():
        self._pages_to_refresh.append(page_id)
        return

    data = {
        "pageId": page_id,
        "limit": 100,
        "cursor": {"stack": []},
        "chunkNumber": 0,
        "verticalColumns": False,
    }

    recordmap = self._client.post("loadPageChunk", data).json()["recordMap"]

    self.store_recordmap(recordmap)

def call_query_collection(
    self,
    collection_id,
    collection_view_id,
    search="",
    type="table",
    aggregate=[],
    aggregations=[],
    filter={},
    sort=[],
    calendar_by="",
    group_by="",
):

    assert not (
        aggregate and aggregations
    ), "Use only one of `aggregate` or `aggregations` (old vs new format)"

    # convert singletons into lists if needed
    if isinstance(aggregate, dict):
        aggregate = [aggregate]
    if isinstance(sort, dict):
        sort = [sort]

    data = {
        "collectionId": collection_id,
        "collectionViewId": collection_view_id,
        "loader": {
            "limit": 1000000,
            "loadContentCover": True,
            "searchQuery": search,
            "userLocale": "en",
            "userTimeZone": str(get_localzone()),
            "type": type,
        },
        "query": {
            "aggregate": aggregate,
            "aggregations": aggregations,
            "filter": filter,
            "sort": sort,
        },
    }

    response = self._client.post("queryCollection", data).json()

    self.store_recordmap(response["recordMap"])

    return response["result"]

def search_pages_with_parent(self, parent_id, search=""):
    data = {
        "query": search,
        "parentId": parent_id,
        "limit": 100,
        "spaceId": self.current_space.id,
    }
    response = self.post("searchPagesWithParent", data).json()
    self._store.store_recordmap(response["recordMap"])
    return response["results"]

notion.store.RecordStore.call_load_page_chunk = call_load_page_chunk
notion.store.RecordStore.call_query_collection = call_query_collection
notion.client.NotionClient.search_pages_with_parent = search_pages_with_parent

The very hot, hot-fix based on #293

[Danappelxx]

@ttran that did the trick, thank you!

[nissy131]

FYI, the API has been also changed so that requesting loadPageChunk multiple times will result in a 429 error(Too Many Requests).
In my case, I had to wait about a minute.