Skip to content

Support float16 and bfloat16 embedding data type#1579

Merged
JinHai-CN merged 14 commits intoinfiniflow:mainfrom
yangzq50:support_embedding_fp16_bf16
Aug 4, 2024
Merged

Support float16 and bfloat16 embedding data type#1579
JinHai-CN merged 14 commits intoinfiniflow:mainfrom
yangzq50:support_embedding_fp16_bf16

Conversation

@yangzq50
Copy link
Member

@yangzq50 yangzq50 commented Aug 2, 2024

What problem does this PR solve?

Support float16 and bfloat16 embedding data type

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • New Feature (non-breaking change which adds functionality)
  • Breaking Change (fix or feature that could cause existing functionality not to work as expected)
  • Refactoring
  • Performance Improvement
  • Test cases
  • Python SDK impacted, Need to update PyPI

@yangzq50 yangzq50 added ci PR can be test and removed ci PR can be test labels Aug 2, 2024
@yangzq50 yangzq50 force-pushed the support_embedding_fp16_bf16 branch from 046e31a to d497e2f Compare August 2, 2024 10:10
@yangzq50 yangzq50 added ci PR can be test and removed ci PR can be test labels Aug 2, 2024
@yangzq50 yangzq50 force-pushed the support_embedding_fp16_bf16 branch from fe193b3 to 3fa5e99 Compare August 2, 2024 10:23
@yangzq50 yangzq50 force-pushed the support_embedding_fp16_bf16 branch from 3fa5e99 to b3e5582 Compare August 2, 2024 10:29
@JinHai-CN JinHai-CN merged commit cb5559f into infiniflow:main Aug 4, 2024
@yangzq50 yangzq50 deleted the support_embedding_fp16_bf16 branch August 5, 2024 03:46
JinHai-CN added a commit that referenced this pull request Aug 5, 2024
…1588)

### What problem does this PR solve?

Fix bug for bit, float16 and bfloat16 embedding type
Add python test for float16 and bfloat16 embedding type

Fix #1579

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Refactoring
- [x] Test cases

---------

Co-authored-by: Jin Hai <haijin.chn@gmail.com>
@yingfeng yingfeng mentioned this pull request Aug 8, 2024
79 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci PR can be test

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

Comments