IEEE Transactions on Transportation Electrification · 2024 · 29 citations · 34 references
ComputingComputer ScienceElectrochemical EngineeringMachine LearningNatural Language ProcessingBattery SystemsElectrochemical CellsEnergy StorageLanguage ModelingLanguage ModelsState Of Charge EstimationBattery ModelingBattery State Of Charge ModelingData-driven State Of Charge EstimationLanguage Model PretrainingLarge Language ModelsLithium-ion BatteriesLithium-ion Battery State Of Charge EstimationState Of Charge Prediction
State-of-charge (SOC) estimation is critical for reliable operation of Li-ion batteries (LIBs). However, the distinct electrochemical characteristics coupled with harsh low-temperature environments make a single estimator struggle to robustly estimate the volatile SOC of multi-type LIBs. To address these issues, this article proposes a hard-soft hybrid prompt learning method to unleash the potential of a pretrained large language model (LLM) for SOC estimation. A textual encoder is introduced to convert LIB measurements into hard text prompts for language modeling, naturally eliciting the pretrained LLM to capture the intra-relations of measured values over time and their inter-relations with contextual semantics for accurate estimates. A side adapter network is constructed to reparameterize model adaptation towards different LIB tasks into optimizations within a low-dimensional subspace, strengthening the estimation generalization of the pretrained LLM in a parameter-efficient manner. A knowledge infusion mechanism is designed to encapsulate task-specific information as soft prompt vectors for model integration along forward propagation, dynamically conditioning the hidden states inside the pretrained LLM to enhance the estimation robustness against SOC volatilities. Extensive experiments verify that the hybrid prompt-driven LLM can simultaneously perform estimations for multi-type LIBs under diverse operations and sub-zero temperatures with superior accuracy, generalization, and robustness.
34
Large language models encode clinical knowledge
Karan Singhal, Shekoofeh Azizi, Tao Tu et al. · Nature · 2023 · 3.2K citations · Full text
Computing, Health Informatics, Computational Linguistics +16