Morse index of saddle equilibria of gradient like flows on connected sums of mathbb S n 1 times mathbb S 1 . Let M be either n sphere mathbb S n or a connected sum of finitely many copies of mathbb S n 1 times mathbb S 1 , n geq4 . A flow f t on M is called gradient like whenever its non wandering set consists of finitely many hyperbolic equilibria and their invariant manifolds intersects transversally. We prove that if invariant manifolds of distinct saddles of a gradient like flow f t on M do not intersect each other (in other words, f t has no heteroclinic intersections), then for each saddle of f t its Morse index (i.e. dimension of the unstable manifold) is either 1 or n 1 , so there are no saddles with Morse indices i in 2, ldots,n 2 .


Data Analysis Communicating with Offshore Vendors using Instant Messaging Services. The purpose of this study is to find whether the choice of correct analytic process is effective to derive a meaningful and correct conclusion from the vast amount of information. For this purpose, I designed an analytic framework to investigate the importance of effective communication on the success of IT business. Through an detailed analysis of chat conversations between a outsource service provider and client, this study found evidence to suggest that the language used in instant messaging environments between clients offshore providers was highly fragmented and broken, but both the client and offshore provider did not seemed to be impacted by these anomalies.


Unknown box Approximation to Improve Optical Character Recognition Performance. Optical character recognition (OCR) is a widely used pattern recognition application in numerous domains. There are several feature rich, general purpose OCR solutions available for consumers, which can provide moderate to excellent accuracy levels. However, accuracy can diminish with difficult and uncommon document domains. Preprocessing of document images can be used to minimize the effect of domain shift. In this paper, a novel approach is presented for creating a customized preprocessor for a given OCR engine. Unlike the previous OCR agnostic preprocessing techniques, the proposed approach approximates the gradient of a particular OCR engine to train a preprocessor module. Experiments with two datasets and two OCR engines show that the presented preprocessor is able to improve the accuracy of the OCR up to 46 from the baseline by applying pixel level manipulations to the document image. The implementation of the proposed method and the enhanced public datasets are available for download.


Deep Learning Based Scene Simplification for Bionic Vision. Retinal degenerative diseases cause profound visual impairment in more than 10 million people worldwide, and retinal prostheses are being developed to restore vision to these individuals. Analogous to cochlear implants, these devices electrically stimulate surviving retinal cells to evoke visual percepts (phosphenes). However, the quality of current prosthetic vision is still rudimentary. Rather than aiming to restore "natural" vision, there is potential merit in borrowing state of the art computer vision algorithms as image processing techniques to maximize the usefulness of prosthetic vision. Here we combine deep learning based scene simplification strategies with a psychophysically validated computational model of the retina to generate realistic predictions of simulated prosthetic vision, and measure their ability to support scene understanding of sighted subjects (virtual patients) in a variety of outdoor scenarios. We show that object segmentation may better support scene understanding than models based on visual saliency and monocular depth estimation. In addition, we highlight the importance of basing theoretical predictions on biologically realistic models of phosphene shape. Overall, this work has the potential to drastically improve the utility of prosthetic vision for people blinded from retinal degenerative diseases.


Put your money where your mouth is Using deep learning to identify consumer tribes from word usage. Internet and social media offer firms novel ways of managing their marketing strategy and gain competitive advantage. The groups of users expressing themselves on the Internet about a particular topic, product, or brand are frequently called a virtual tribe or E tribe. However, there are no automatic tools for identifying and studying the characteristics of these virtual tribes. Towards this aim, this paper presents Tribefinder, a system to reveal Twitter users' tribal affiliations, by analyzing their tweets and language use. To show the potential of this instrument, we provide an example considering three specific tribal macro categories alternative realities, lifestyle, and recreation. In addition, we discuss the different characteristics of each identified tribe, in terms of use of language and social interaction metrics. Tribefinder illustrates the importance of adopting a new lens for studying virtual tribes, which is crucial for firms to properly design their marketing strategy, and for scholars to extend prior marketing research.


Coronary Artery Disease Research in India A Scientometric Assessment of Publication during 1990 2019. The present study examined 4698 Indian Coronary Artery Disease research publications, as indexed in Web of Science database during 1990 2019, with a view to understand their growth rate, global share, citation impact, international collaborative papers, distribution of publications by broad subjects, productivity and citation profile of top organizations and authors, and preferred media of communication. The Indian publications registered an annual average growth rate of 11.47 , global share of 1.14 , international collaborative publications share of 38.89 and its citation impact averaged to 25.58 citations per paper. Among broad subjects, Cardiovascular System Cardiology contributed the largest publications share of 19.14 in Indian coronary artery disease output, followed by Neurosciences Neurology (14.94 ), Pharmacology Pharmacy (8.51 ), etc. during 1990 2019. Among various organizations and authors contributing to Indian coronary artery disease research, the top 20 organizations and top 30 authors together contributed 40.70 and 37.29 respectively as their share of Indian publication output and 38.36 and 33.13 respectively as their share of Indian citation output during 1990 2019. Among 1222 contributing journals in Indian coronary artery disease research, the top 30 journals registered 30.80 share during 1990 2019. There is an urgent need to increase the publication output, improve research quality and improve international collaboration. Indian government also needs to come up with a policy for identification, screening, diagnosis and treatment of coronary artery disease patients, besides curriculum reform in teaching, capacity building, patient education and political support are badly needed.


Sparse bounds for pseudo multipliers associated to Grushin operators, I. In a recent work BG21 , first and third authors studied pseudo multipliers associated to the Grushin operator G Delta x prime x' 2 Delta x prime prime on mathbb R n 1 n 2 , proving analogues of Calder 'on Vaillancourt type theorems. In this article, we further extend the analysis of BG21 and investigate quantitative weighted L p boundedness for Grushin pseudo multipliers as well as for a family of operator valued Fourier pseudo multipliers in the context of the Grushin operator G . We establish pointwise domination of these operators by sparse operators. We also address analogous questions for pseudo multipliers associated to a more general family of Grushin operators.


Automated Detection of Equine Facial Action Units. The recently developed Equine Facial Action Coding System (EquiFACS) provides a precise and exhaustive, but laborious, manual labelling method of facial action units of the horse. To automate parts of this process, we propose a Deep Learning based method to detect EquiFACS units automatically from images. We use a cascade framework we firstly train several object detectors to detect the predefined Region of Interest (ROI), and secondly apply binary classifiers for each action unit in related regions. We experiment with both regular CNNs and a more tailored model transferred from human facial action unit recognition. Promising initial results are presented for nine action units in the eye and lower face regions. Code for the project is publicly available.


More but Correct Generating Diversified and Entity revised Medical Response. Medical Dialogue Generation (MDG) is intended to build a medical dialogue system for intelligent consultation, which can communicate with patients in real time, thereby improving the efficiency of clinical diagnosis with broad application prospects. This paper presents our proposed framework for the Chinese MDG organized by the 2021 China conference on knowledge graph and semantic computing (CCKS) competition, which requires generating context consistent and medically meaningful responses conditioned on the dialogue history. In our framework, we propose a pipeline system composed of entity prediction and entity aware dialogue generation, by adding predicted entities to the dialogue model with a fusion mechanism, thereby utilizing information from different sources. At the decoding stage, we propose a new decoding mechanism named Entity revised Diverse Beam Search (EDBS) to improve entity correctness and promote the length and quality of the final response. The proposed method wins both the CCKS and the International Conference on Learning Representations (ICLR) 2021 Workshop Machine Learning for Preventing and Combating Pandemics (MLPCP) Track 1 Entity aware MED competitions, which demonstrate the practicality and effectiveness of our method.


Slope inequalities for KSB stable and K stable families. We prove some higher dimensional generalizations of the slope inequality originally due to G. Xiao, and to M. Cornalba and J. Harris. We give applications to families of KSB stable and K stable pairs, as well as to the study of the ample cone of the moduli space of KSB stable varieties. Our proofs relies on the study of the Harder Narasimhan filtration, and some generalizations of Castelnuovo's and Noether's inequalities.


A visual study on the spray of gas liquid atomizer. A Visual investigation of spray cone angle for different air blast atomizers and flow conditions is described. Liquid jets are exposed to high gas stream with specific relative angle. Using high speed camera, spray cone angle over a range of Reynolds number 4x104 to 9x104 and Weber number 1 to 140 is studied, followed by laser based diagnosis of particle distribution and Sauter mean diameter. The results show that for high Reynolds and Weber number, the cone angle is independent of flow condition, and is only dependent on geometry of atomizer, including orifice diameter with significant effect on cone angle, Sauter mean diameter and particle distribution


The Ihara zeta function and the spectrum of the join of two semi regular bipartite graphs. In this paper, using matrix techniques, we compute the Ihara zeta function and the number of spanning trees of the join of two semi regular bipartite graphs. Furthermore, we show that the spectrum and the zeta function of the join of two semi regular bipartite graphs can determine each other.


Numerical Investigation of a Rectangular Jet Exhausting over a Flat Plate with Periodic Surface Deformations at the Trailing Edge. In an attempt to reduce jet noise, blended wing concept vehicle utilizes rectangular jet exhaust ports exiting from above the wing ahead of the trailing edge. In this study, we take another look at the rectangular exhaust port configuration with some notional modifications to the geometry of the trailing edge to determine if the emitted noise levels due to jet interactions can be reduced with respect to a baseline configuration. We consider various horizontal and vertical offsets of the jet exit with respect to a flat plate standing in for the aft wing surface. We then introduce a series of sinusoidal deformations to the trailing edge of the plate of varying amplitude and wave number. Our results show that the emitted sound levels due to the jet surface interactions can be significantly altered by the proposed geometry modifications. While sound levels remained fairly consistent over many configurations, there were some that showed both increased and decreased sound levels in specific directions. We present results here for the simulated configurations which showed the greatest decrease in overall sound levels with respect to the baseline. These results provide strong indications that such geometry modifications can potentially be tailored to optimize for further reductions in sound levels.


Combinatorial Contracts. We introduce a new model of combinatorial contracts in which a principal delegates the execution of a costly task to an agent. To complete the task, the agent can take any subset of a given set of unobservable actions, each of which has an associated cost. The cost of a set of actions is the sum of the costs of the individual actions, and the principal's reward as a function of the chosen actions satisfies some form of diminishing returns. The principal incentivizes the agents through a contract, based on the observed outcome. Our main results are for the case where the task delegated to the agent is a project, which can be successful or not. We show that if the success probability as a function of the set of actions is gross substitutes, then an optimal contract can be computed with polynomially many value queries, whereas if it is submodular, the optimal contract is NP hard. All our results extend to linear contracts for higher dimensional outcome spaces, which we show to be robustly optimal given first moment constraints. Our analysis uncovers a new property of gross substitutes functions, and reveals many interesting connections between combinatorial contracts and combinatorial auctions, where gross substitutes is known to be the frontier for efficient computation.


Thom's counterexamples for the Steenrod problem. The present paper deals with integral classes xi p in H 2p 1 (L 1 2p 1 times L 2 2p 1 ) which are counterexamples for the Steenrod realization problem, where L 1 2p 1 is the (2p 1) Lens space and p geq 3 is a prime number. For p 3 , this is the Thom's famous counterexample. We give a geometric description of this class using the theory of stratifolds. As a consequence, we obtain a geometric interpretation of the obstruction to realizability, in terms of the Atiyah Hirzebruch spectral sequence.


LEAF Navigating Concept Drift in Cellular Networks. Operational networks commonly rely on machine learning models for many tasks, including detecting anomalies, inferring application performance, and forecasting demand. Yet, unfortunately, model accuracy can degrade due to concept drift, whereby the relationship between the features and the target prediction changes due to reasons ranging from software upgrades to seasonality to changes in user behavior. Mitigating concept drift is thus an essential part of operationalizing machine learning models, and yet despite its importance, concept drift has not been extensively explored in the context of networking or regression models in general. Thus, it is not well understood how to detect or mitigate it for many common network management tasks that currently rely on machine learning models. As we show, concept drift cannot always be mitigated by periodic retraining models using newly available data, and doing so can even degrade model accuracy. In this paper, we characterize concept drift in a large cellular network for a metropolitan area in the United States. We find that concept drift occurs across key performance indicators (KPIs), regardless of model, training set size, and time interval thus necessitating practical approaches to detect, explain, and mitigate it. To do so, we develop Local Error Approximation of Features (LEAF). LEAF detects drift explains features and time intervals that most contribute to drift and mitigates drift using resampling, augmentation, or ensembling. We evaluate LEAF against industry standard mitigations (i.e., periodic retraining) with more than three years of cellular data from Verizon. LEAF consistently outperforms periodic retraining on a variety of KPIs and models, while reducing costly retrains by an order of magnitude. Due to its effectiveness, a major cellular carrier is now integrating LEAF into its forecasting and provisioning processes.


Particle In Cell Simulation using Asynchronous Tasking. Recently, task based programming models have emerged as a prominent alternative among shared memory parallel programming paradigms. Inherently asynchronous, these models provide native support for dynamic load balancing and incorporate data flow concepts to selectively synchronize the tasks. However, tasking models are yet to be widely adopted by the HPC community and their effective advantages when applied to non trivial, real world HPC applications are still not well comprehended. In this paper, we study the parallelization of a production electromagnetic particle in cell (EM PIC) code for kinetic plasma simulations exploring different strategies using asynchronous task based models. Our fully asynchronous implementation not only significantly outperforms a conventional, synchronous approach but also achieves near perfect scaling for 48 cores.


Automating the Compilation of Potential Core Outcomes for Clinical Trials. Due to increased access to clinical trial outcomes and analysis, researchers and scientists are able to iterate or improve upon relevant approaches more effectively. However, the metrics and related results of clinical trials typically do not follow any standardization in their reports, making it more difficult for researchers to parse the results of different trials. The objective of this paper is to describe an automated method utilizing natural language processing in order to describe the probable core outcomes of clinical trials, in order to alleviate the issues around disparate clinical trial outcomes. As the nature of this process is domain specific, BioBERT was employed in order to conduct a multi class entity normalization task. In addition to BioBERT, an unsupervised feature based approach making use of only the encoder output embedding representations for the outcomes and labels was utilized. Finally, cosine similarity was calculated across the vectors to obtain the semantic similarity. This method was able to both harness the domain specific context of each of the tokens from the learned embeddings of the BioBERT model as well as a more stable metric of sentence similarity. Some common outcomes identified using the Jaccard similarity in each of the classifications were compiled, and while some are untenable, a pipeline for which this automation process could be conducted was established.


The (1 1) ES Reliably Overcomes Saddle Points. It is known that step size adaptive evolution strategies (ES) do not converge (prematurely) to regular points of continuously differentiable objective functions. Among critical points, convergence to minima is desired, and convergence to maxima is easy to exclude. However, surprisingly little is known on whether ES can get stuck at a saddle point. In this work we establish that even the simple (1 1) ES reliably overcomes most saddle points under quite mild regularity conditions. Our analysis is based on drift with tail bounds. It is non standard in that we do not even aim to estimate hitting times based on drift. Rather, in our case it suffices to show that the relevant time is finite with full probability.


Location Sensitive Visual Recognition with Cross IOU Loss. Object detection, instance segmentation, and pose estimation are popular visual recognition tasks which require localizing the object by internal or boundary landmarks. This paper summarizes these tasks as location sensitive visual recognition and proposes a unified solution named location sensitive network (LSNet). Based on a deep neural network as the backbone, LSNet predicts an anchor point and a set of landmarks which together define the shape of the target object. The key to optimizing the LSNet lies in the ability of fitting various scales, for which we design a novel loss function named cross IOU loss that computes the cross IOU of each anchor point landmark pair to approximate the global IOU between the prediction and ground truth. The flexibly located and accurately predicted landmarks also enable LSNet to incorporate richer contextual information for visual recognition. Evaluated on the MS COCO dataset, LSNet set the new state of the art accuracy for anchor free object detection (a 53.5 box AP) and instance segmentation (a 40.2 mask AP), and shows promising performance in detecting multi scale human poses. Code is available at https github.com Duankaiwen LSNet


Deep learning based geometric registration for medical images How accurate can we get without visual features?. As in other areas of medical image analysis, e.g. semantic segmentation, deep learning is currently driving the development of new approaches for image registration. Multi scale encoder decoder network architectures achieve state of the art accuracy on tasks such as intra patient alignment of abdominal CT or brain MRI registration, especially when additional supervision, such as anatomical labels, is available. The success of these methods relies to a large extent on the outstanding ability of deep CNNs to extract descriptive visual features from the input images. In contrast to conventional methods, the explicit inclusion of geometric information plays only a minor role, if at all. In this work we take a look at an exactly opposite approach by investigating a deep learning framework for registration based solely on geometric features and optimisation. We combine graph convolutions with loopy belief message passing to enable highly accurate 3D point cloud registration. Our experimental validation is conducted on complex key point graphs of inner lung structures, strongly outperforming dense encoder decoder networks and other point set registration methods. Our code is publicly available at https github.com multimodallearning deep geo reg.


Boundedness of Fractional Integrals on Special John Nirenberg Campanato and Hardy Type Spaces via Congruent Cubes. Let p in 1, infty , q in 1, infty) , s in mathbb Z mathbb N cup 0 , and alpha in mathbb R . In this article, the authors first find a reasonable version widetilde I beta of the (generalized) fractional integral I beta on the special John Nirenberg Campanato space via congruent cubes, JN (p,q,s) alpha mathrm con ( mathbb R n) , which coincides with the Campanato space mathcal C alpha,q,s ( mathbb R n) when p infty . To this end, the authors introduce the vanishing moments up to order s of I beta . Then the authors prove that widetilde I beta is bounded from JN (p,q,s) alpha mathrm con ( mathbb R n) to JN (p,q,s) alpha beta n mathrm con ( mathbb R n) if and only if I beta has the vanishing moments up to order s . The obtained result is new even when p infty and s in mathbb N . Moreover, the authors show that I beta can be extended to a unique continuous linear operator from the Hardy kind space HK (p,q,s) alpha beta n mathrm con ( mathbb R n) , the predual of JN (p',q',s) alpha beta n mathrm con ( mathbb R n) with frac 1 p frac 1 p' 1 frac 1 q frac 1 q' , to HK (p,q,s) alpha mathrm con ( mathbb R n) if and only if I beta has the vanishing moments up to order s . The proof of the latter boundedness strongly depends on the dual relation (HK (p,q,s) alpha mathrm con ( mathbb R n)) JN (p',q',s) alpha mathrm con ( mathbb R n) , the properties of molecules of HK (p,q,s) alpha mathrm con ( mathbb R n) , and a crucial criterion for the boundedness of linear operators on HK (p,q,s) alpha mathrm con ( mathbb R n) .


Diffusion approximation for multi scale stochastic reaction diffusion equations. In this paper, we study the diffusion approximation for singularly perturbed stochastic reaction diffusion equation with a fast oscillating term. The asymptotic limit for the original system is obtained, where an extra Gaussian term appears. Such a term is explicitly given in terms of the solution of Poisson equation in Hilbert space. Moreover, we also obtain the optimal rate of convergence, and the convergence rate is shown not to depend on the regularity of the coefficients of the original system with respect to the fast variable, which coincides with the intuition since the fast component has been totally homogenized out in the limit equation.


A classification of the finite two generated cyclic by abelian groups of prime power order. We obtain a classification of the finite two generated cyclic by abelian groups of prime power order. For that we associate to each such group G a list inv (G) of numerical group invariants which determines the isomorphism type of G . Then we describe the set formed by all the possible values of inv (G) .


High order Field Theory and Weak Euler Lagrange Barut Equation for Classical Relativistic Particle Field Systems. It is widely accepted that conservation laws, especially energy momentum conservation, have fundamental importance for both classical and quantum systems in physics. A widely used method to derive the conservation laws is based on Noether's theorem. However, for classical relativistic particle field systems, this process is still impeded. Different from the quantum situation, the obstruction emerged when we regard the particle's field as a classical world line. The difficulties come from two aspects. One is the mass shell constraint and the other comes from the heterogeneous manifolds that particles and fields reside on. This study develops a general geometric (manifestly covariant) field theory for classical relativistic particle field systems. In considering the mass shell constraint, the Euler Lagrange Barut (ELB) equation as a geometric version of the Euler Lagrange (EL) equation is applied to determine the world lines of the relativistic particles. As a differential equation in the standard field theory, the infinitesimal criterion of the symmetry condition is converted into an integro differential equation. To overcome the second difficulty, we develop a weak ELB equation on the 4D space time. The weak version of the ELB equation will play an essential role in establishing the connections between symmetries and local conservation laws. Using field theory together with the weak ELB equation developed here, the conservation laws can be systematically derived from the symmetries that the systems admit.


HPOBench A Collection of Reproducible Multi Fidelity Benchmark Problems for HPO. To achieve peak predictive performance, hyperparameter optimization (HPO) is a crucial component of machine learning and its applications. Over the last years, the number of efficient algorithms and tools for HPO grew substantially. At the same time, the community is still lacking realistic, diverse, computationally cheap, and standardized benchmarks. This is especially the case for multi fidelity HPO methods. To close this gap, we propose HPOBench, which includes 7 existing and 5 new benchmark families, with a total of more than 100 multi fidelity benchmark problems. HPOBench allows to run this extendable set of multi fidelity HPO benchmarks in a reproducible way by isolating and packaging the individual benchmarks in containers. It also provides surrogate and tabular benchmarks for computationally affordable yet statistically sound evaluations. To demonstrate HPOBench's broad compatibility with various optimization tools, as well as its usefulness, we conduct an exemplary large scale study evaluating 13 optimizers from 6 optimization tools. We provide HPOBench here https github.com automl HPOBench.


Nikolskii Type Inequalities for Entire Functions of Exponential Type in Lorentz Zygmund Spaces. Nikolskii type inequalities for entire functions of exponential type on Rn for the Lorentz Zygmund spaces are obtained. Some new limiting cases are examined. Application to Besov type spaces of logarithmic smoothness is given.


Implementation of RPL in OMNeT . The growth and evolution of Internet of Things (IoT) is now of paramount importance for next generation networks, including the upcoming 6G. In particular, there is a set of constrained IoT nodes that comprise the Low Power and Lossy Networks (LLNs), which have very particular requirements. The current standard for routing in those networks is RPL, which was defined less than a decade ago and still needs improvements in terms of scalability or integration with other networks. Many researchers currently need an implementation of RPL to evaluate their works and, for that reason, among others, we implemented it in the OMNeT simulator. The results of this implementation show that is an easy way to check prototypes in their very initial develop phases, and its code is publicly available for the research community.


Object Detection for Understanding Assembly Instruction Using Context aware Data Augmentation and Cascade Mask R CNN. Understanding assembly instruction has the potential to enhance the robot s task planning ability and enables advanced robotic applications. To recognize the key components from the 2D assembly instruction image, We mainly focus on segmenting the speech bubble area, which contains lots of information about instructions. For this, We applied Cascade Mask R CNN and developed a context aware data augmentation scheme for speech bubble segmentation, which randomly combines images cuts by considering the context of assembly instructions. We showed that the proposed augmentation scheme achieves a better segmentation performance compared to the existing augmentation algorithm by increasing the diversity of trainable data while considering the distribution of components locations. Also, we showed that deep learning can be useful to understand assembly instruction by detecting the essential objects in the assembly instruction, such as tools and parts.


Out of Vocabulary Entities in Link Prediction. Knowledge graph embedding techniques are key to making knowledge graphs amenable to the plethora of machine learning approaches based on vector representations. Link prediction is often used as a proxy to evaluate the quality of these embeddings. Given that the creation of benchmarks for link prediction is a time consuming endeavor, most work on the subject matter uses only a few benchmarks. As benchmarks are crucial for the fair comparison of algorithms, ensuring their quality is tantamount to providing a solid ground for developing better solutions to link prediction and ipso facto embedding knowledge graphs. First studies of benchmarks pointed to limitations pertaining to information leaking from the development to the test fragments of some benchmark datasets. We spotted a further common limitation of three of the benchmarks commonly used for evaluating link prediction approaches out of vocabulary entities in the test and validation sets. We provide an implementation of an approach for spotting and removing such entities and provide corrected versions of the datasets WN18RR, FB15K 237, and YAGO3 10. Our experiments on the corrected versions of WN18RR, FB15K 237, and YAGO3 10 suggest that the measured performance of state of the art approaches is altered significantly with p values 1 , 1.4 , and 1 , respectively. Overall, state of the art approaches gain on average absolute 3.29 pm 0.24 in all metrics on WN18RR. This means that some of the conclusions achieved in previous works might need to be revisited. We provide an open source implementation of our experiments and corrected datasets at at https github.com dice group OOV In Link Prediction.


Differentially Private Densest Subgraph. Given a graph, the densest subgraph problem asks for a set of vertices such that the average degree among these vertices is maximized. Densest subgraph has numerous applications in learning, e.g., community detection in social networks, link spam detection, correlation mining, bioinformatics, and so on. Although there are efficient algorithms that output either exact or approximate solutions to the densest subgraph problem, existing algorithms may violate the privacy of the individuals in the network, e.g., leaking the existence non existence of edges. In this paper, we study the densest subgraph problem in the framework of the differential privacy, and we derive the first upper and lower bounds for this problem. We show that there exists a linear time epsilon differentially private algorithm that finds a 2 approximation of the densest subgraph with an extra poly logarithmic additive error. Our algorithm not only reports the approximate density of the densest subgraph, but also reports the vertices that form the dense subgraph. Our upper bound almost matches the famous 2 approximation by Charikar both in performance and in approximation ratio, but we additionally achieve differential privacy. In comparison with Charikar's algorithm, our algorithm has an extra poly logarithmic additive error. We partly justify the additive error with a new lower bound, showing that for any differentially private algorithm that provides a constant factor approximation, a sub logarithmic additive error is inherent. We also practically study our differentially private algorithm on real world graphs, and we show that in practice the algorithm finds a solution which is very close to the optimal


Universal stereodynamics of cold atom molecule collisions in electric fields. We use numerically exact quantum dynamics calculations to demonstrate universal stereoselectivity of cold collisions of 2 Pi molecules with 1 S state atoms in an external electric field. We show that cold collisions of OH molecules in their low field seeking f states, whose dipole moments are oriented against the field direction, are much more likely to lead to inelastic scattering than those of molecules oriented along the field direction, causing nearly perfect steric asymmetry in the inelastic collision cross sections. The universal nature of this effect is due to the threshold suppression of inelastic scattering between the degenerate pm M Stark sublevels of the high field seeking e state, where M is the projection of the total angular momentum of the molecule on the field axis. Above the Lambda doublet threshold, the stereodynamics of inelastic atom molecule collisions can be tuned via electric field induced resonances, which enable effective control of Ne OH scattering over the range of collision energies achievable in current merged beam experiments.


A Label Management Mechanism for Retinal Fundus Image Classification of Diabetic Retinopathy. Diabetic retinopathy (DR) remains the most prevalent cause of vision impairment and irreversible blindness in the working age adults. Due to the renaissance of deep learning (DL), DL based DR diagnosis has become a promising tool for the early screening and severity grading of DR. However, training deep neural networks (DNNs) requires an enormous amount of carefully labeled data. Noisy label data may be introduced when labeling plenty of data, degrading the performance of models. In this work, we propose a novel label management mechanism (LMM) for the DNN to overcome overfitting on the noisy data. LMM utilizes maximum posteriori probability (MAP) in the Bayesian statistic and time weighted technique to selectively correct the labels of unclean data, which gradually purify the training data and improve classification performance. Comprehensive experiments on both synthetic noise data (Messidor our collected DR dataset) and real world noise data (ANIMAL 10N) demonstrated that LMM could boost performance of models and is superior to three state of the art methods.


FIFA Fast Inference Approximation for Action Segmentation. We introduce FIFA, a fast approximate inference method for action segmentation and alignment. Unlike previous approaches, FIFA does not rely on expensive dynamic programming for inference. Instead, it uses an approximate differentiable energy function that can be minimized using gradient descent. FIFA is a general approach that can replace exact inference improving its speed by more than 5 times while maintaining its performance. FIFA is an anytime inference algorithm that provides a better speed vs. accuracy trade off compared to exact inference. We apply FIFA on top of state of the art approaches for weakly supervised action segmentation and alignment as well as fully supervised action segmentation. FIFA achieves state of the art results on most metrics on two action segmentation datasets.


Capillary surfaces stability, index and curvature estimates. In this paper we investigate the connection between the index and the geometry and topology of capillary surfaces. We prove an index estimate for compact capillary surfaces immersed in general 3 manifolds with boundary. We also study noncompact capillary surfaces with finite index and show that, under suitable curvature assumptions, such surface is conformally equivalent to a compact Riemann surface with boundary, punctured at finitely many points. We then prove that a weakly stable capillary surface immersed in a half space of mathbb R 3 which is minimal or has a contact angle less than or equal to pi 2 must be a half plane. Using this uniqueness result we obtain curvature estimates for strongly stable capillary surfaces immersed in a 3 manifold with bounded geometry.


Compositional Security for Reentrant Applications. The disastrous vulnerabilities in smart contracts sharply remind us of our ignorance we do not know how to write code that is secure in composition with malicious code. Information flow control has long been proposed as a way to achieve compositional security, offering strong guarantees even when combining software from different trust domains. Unfortunately, this appealing story breaks down in the presence of reentrancy attacks. We formalize a general definition of reentrancy and introduce a security condition that allows software modules like smart contracts to protect their key invariants while retaining the expressive power of safe forms of reentrancy. We present a security type system that provably enforces secure information flow in conjunction with run time mechanisms, it enforces secure reentrancy even in the presence of unknown code and it helps locate and correct recent high profile vulnerabilities.


An Empirical Study on Transfer Learning for Privilege Review. Protecting privileged communications and data from inadvertent disclosure is a paramount task in the US legal practice. Traditionally counsels rely on keyword searching and manual review to identify privileged documents in cases. As data volumes increase, this approach becomes less and less defensible in costs. Machine learning methods have been used in identifying privilege documents. Given the generalizable nature of privilege in legal cases, we hypothesize that transfer learning can capitalize knowledge learned from existing labeled data to identify privilege documents without requiring labeling new training data. In this paper, we study both traditional machine learning models and deep learning models based on BERT for privilege document classification tasks in legal document review, and we examine the effectiveness of transfer learning in privilege model on three real world datasets with privilege labels. Our results show that BERT model outperforms the industry standard logistic regression algorithm and transfer learning models can achieve decent performance on datasets in same or close domains.


Low energy consumption, free form capacitive deionisation through nanostructured networks. Capacitive Deionization (CDI) is a non energy intensive water treatment technology. To harness the enormous potential of CDI requires improving performance, while offering industrially feasible solutions. Following this idea, the replacement of costly metallic components has been proposed as a mean of limiting corrosion problems. This work explores the use of nanostructured hybrid networks to enable free form and metal free CDI devices. The strategy consists of producing interpenetrated networks of highly conductive flexible carbon nanotube (CNT) fibre fabrics and nanostructured metal oxides, gamma Al2O3 and TiO2, through ultrasound assisted nanoparticle infiltration and sintering. In the resulting hybrids, a uniform distribution of porous metal oxide is firmly attached to the nanocarbon network while the flexibility, high conductivity and low dimensional properties of the CNTs are preserved. These electrodes present a high porosity ( 105 118 m 2 g 1 ), notably low electrical ( 0,1 k Omega cm 2 ) and low charge transfer resistance (4 Omega ), thus enabling the infiltration of aqueous electrolytes and serving as current collector. In this work we built a large asymmetrical cylindrical CDI device solely made of these electrodes and conventional plastics. The cell provides, high average salt adsorption rates of 1.16 mg g AM min ( 0.23 mg g CDIunit min , low energy consumption ( 0.18 Wh g salt ) and stable electrochemical performance above 50 cycles for brackish water desalination.


Graded dimensions and monomial bases for the cyclotomic quiver Hecke algebras. In this paper we give a closed formula for the graded dimension of the cyclotomic quiver Hecke algebra R Lambda( beta) associated to an it arbitrary symmetrizable Cartan matrix A (a ij ) i,j in I , where Lambda in P and beta in Q n . As applications, we obtain some it necessary and sufficient conditions for the KLR idempotent e( nu) (for any nu in I beta ) to be nonzero in the cyclotomic quiver Hecke algebra R Lambda( beta) . We prove several level reduction results which decomposes dim R Lambda( beta) into a sum of some products of dim R Lambda i ( beta i) with Lambda sum i Lambda i and beta sum i beta i , where Lambda i in P , beta i in Q for each i . We construct some explicit monomial bases for the subspaces e( widetilde nu )R Lambda( beta)e( mu) and e( widetilde nu )R Lambda( beta)e( mu) of R Lambda( beta) , where mu in I beta is it arbitrary and widetilde nu in I beta is a certain specific n tuple (see Section 4).Finally, we use our graded dimension formulae to provide some examples which show that R Lambda(n) is in general not graded free over its natural embedded subalgebra R Lambda(m) with m n .


Revisiting Point Cloud Shape Classification with a Simple and Effective Baseline. Processing point cloud data is an important component of many real world systems. As such, a wide variety of point based approaches have been proposed, reporting steady benchmark improvements over time. We study the key ingredients of this progress and uncover two critical results. First, we find that auxiliary factors like different evaluation schemes, data augmentation strategies, and loss functions, which are independent of the model architecture, make a large difference in performance. The differences are large enough that they obscure the effect of architecture. When these factors are controlled for, PointNet , a relatively older network, performs competitively with recent methods. Second, a very simple projection based method, which we refer to as SimpleView, performs surprisingly well. It achieves on par or better results than sophisticated state of the art methods on ModelNet40 while being half the size of PointNet . It also outperforms state of the art methods on ScanObjectNN, a real world point cloud benchmark, and demonstrates better cross dataset generalization. Code is available at https github.com princeton vl SimpleView.


Fast Learning Grasping and Pre Grasping via Clutter Quantization and Q map Masking. Grasping objects in cluttered scenarios is a challenging task in robotics. Performing pre grasp actions such as pushing and shifting to scatter objects is a way to reduce clutter. Based on deep reinforcement learning, we propose a Fast Learning Grasping (FLG) framework, that can integrate pre grasping actions along with grasping to pick up objects from cluttered scenarios with reduced real world training time. We associate rewards for performing moving actions with the change of environmental clutter and utilize a hybrid triggering method, leading to data efficient learning and synergy. Then we use the output of an extended fully convolutional network as the value function of each pixel point of the workspace and establish an accurate estimation of the grasp probability for each action. We also introduce a mask function as prior knowledge to enable the agents to focus on the accurate pose adjustment to improve the effectiveness of collecting training data and, hence, to learn efficiently. We carry out pre training of the FLG over simulated environment, and then the learnt model is transferred to the real world with minimal fine tuning for further learning during actions. Experimental results demonstrate a 94 grasp success rate and the ability to generalize to novel objects. Compared to state of the art approaches in the literature, the proposed FLG framework can achieve similar or higher grasp success rate with lesser amount of training in the real world. Supplementary video is available at https youtu.be e04uDLsxfDg.


Label Distribution Amendment with Emotional Semantic Correlations for Facial Expression Recognition. By utilizing label distribution learning, a probability distribution is assigned for a facial image to express a compound emotion, which effectively improves the problem of label uncertainties and noises occurred in one hot labels. In practice, it is observed that correlations among emotions are inherently different, such as surprised and happy emotions are more possibly synchronized than surprised and neutral. It indicates the correlation may be crucial for obtaining a reliable label distribution. Based on this, we propose a new method that amends the label distribution of each facial image by leveraging correlations among expressions in the semantic space. Inspired by inherently diverse correlations among word2vecs, the topological information among facial expressions is firstly explored in the semantic space, and each image is embedded into the semantic space. Specially, a class relation graph is constructed to transfer the semantic correlation among expressions into the task space. By comparing semantic and task class relation graphs of each image, the confidence of its label distribution is evaluated. Based on the confidence, the label distribution is amended by enhancing samples with higher confidence and weakening samples with lower confidence. Experimental results demonstrate the proposed method is more effective than compared state of the art methods.


Enhanced Doubly Robust Learning for Debiasing Post click Conversion Rate Estimation. Post click conversion, as a strong signal indicating the user preference, is salutary for building recommender systems. However, accurately estimating the post click conversion rate (CVR) is challenging due to the selection bias, i.e., the observed clicked events usually happen on users' preferred items. Currently, most existing methods utilize counterfactual learning to debias recommender systems. Among them, the doubly robust (DR) estimator has achieved competitive performance by combining the error imputation based (EIB) estimator and the inverse propensity score (IPS) estimator in a doubly robust way. However, inaccurate error imputation may result in its higher variance than the IPS estimator. Worse still, existing methods typically use simple model agnostic methods to estimate the imputation error, which are not sufficient to approximate the dynamically changing model correlated target (i.e., the gradient direction of the prediction model). To solve these problems, we first derive the bias and variance of the DR estimator. Based on it, a more robust doubly robust (MRDR) estimator has been proposed to further reduce its variance while retaining its double robustness. Moreover, we propose a novel double learning approach for the MRDR estimator, which can convert the error imputation into the general CVR estimation. Besides, we empirically verify that the proposed learning scheme can further eliminate the high variance problem of the imputation learning. To evaluate its effectiveness, extensive experiments are conducted on a semi synthetic dataset and two real world datasets. The results demonstrate the superiority of the proposed approach over the state of the art methods. The code is available at https github.com guosyjlu MRDR DL.


A geometric proof of the classification of T polygons. We give a new geometric proof of the classification of T polygons, a theorem originally due to Kasprzyk, Nill, and Prince. We also obtain a Torelli theorem for certain maximally mutable Laurent polynomials in two variables and show that the mirror Landau Ginzburg model to a smooth del Pezzo surface X is determined up to isomorphism by the regularized quantum period of X .


Tree decompositions with bounded independence number and their algorithmic applications. In 2020, Dallard, Milani v c , and v S torgel initiated a systematic study of graphs classes in which the treewidth can only be large due the presence of a large clique, which they call ( textrm tw , omega) bounded. The family of ( textrm tw , omega) bounded graph classes provides a unifying framework for a variety of very different families of graph classes, including graph classes of bounded treewidth, graph classes of bounded independence number, intersection graphs of connected subgraphs of graphs with bounded treewidth, and graphs in which all minimal separators are of bounded size. While Chaplick and Zeman showed in 2017 that ( textrm tw , omega) bounded graph classes enjoy some good algorithmic properties related to clique and coloring problems, an interesting open problem is whether ( textrm tw , omega) boundedness has useful algorithmic implications for problems related to independent sets. We provide a partial answer to this question by identifying a sufficient condition for ( textrm tw , omega) bounded graph classes to admit a polynomial time algorithm for the Maximum Weight Independent mathcal H Packing problem, for any fixed finite set mathcal H of connected graphs. This family of problems generalizes several other problems studied in the literature, including the Maximum Weight Independent Set and Maximum Weight Induced Matching problems. Our approach leads to polynomial time algorithms for the Maximum Weight Independent Set problem in an infinite family of graph classes, each of which properly contains the class of chordal graphs. These results also apply to the class of 1 perfectly orientable graphs, answering a question of Beisegel, Chudnovsky, Gurvich, Milani v c , and Servatius from 2019.


An asymptotically compatible probabilistic collocation method for randomly heterogeneous nonlocal problems. In this paper we present an asymptotically compatible meshfree method for solving nonlocal equations with random coefficients, describing diffusion in heterogeneous media. In particular, the random diffusivity coefficient is described by a finite dimensional random variable or a truncated combination of random variables with the Karhunen Lo e ve decomposition, then a probabilistic collocation method (PCM) with sparse grids is employed to sample the stochastic process. On each sample, the deterministic nonlocal diffusion problem is discretized with an optimization based meshfree quadrature rule. We present rigorous analysis for the proposed scheme and demonstrate convergence for a number of benchmark problems, showing that it sustains the asymptotic compatibility spatially and achieves an algebraic or sub exponential convergence rate in the random coefficients space as the number of collocation points grows. Finally, to validate the applicability of this approach we consider a randomly heterogeneous nonlocal problem with a given spatial correlation structure, demonstrating that the proposed PCM approach achieves substantial speed up compared to conventional Monte Carlo simulations.


Content based subject classification at article level in biomedical context. Subject classification is an important task to analyze scholarly publications. In general, mainly two kinds of approaches are used classification at a journal level and classification at the article level. We propose a mixed approach, leveraging on embeddings technique in NLP to train classifiers with article metadata (title, abstract, keywords in particular) labelled with the journal level classification FoR (Fields of Research) and then apply these classifiers at the article level. We use this approach in the context of biomedical publications using metadata from Pubmed. Fasttext classifiers are trained with FoR codes and used to classify publications based on their available metadata. Results show that using a stratification sampling strategy for training help reduce the bias due to unbalanced field distribution. An implementation of the method is proposed on the repository https github.com dataesr scientific tagger


A Free Lunch From ANN Towards Efficient, Accurate Spiking Neural Networks Calibration. Spiking Neural Network (SNN) has been recognized as one of the next generation of neural networks. Conventionally, SNN can be converted from a pre trained ANN by only replacing the ReLU activation to spike activation while keeping the parameters intact. Perhaps surprisingly, in this work we show that a proper way to calibrate the parameters during the conversion of ANN to SNN can bring significant improvements. We introduce SNN Calibration, a cheap but extraordinarily effective method by leveraging the knowledge within a pre trained Artificial Neural Network (ANN). Starting by analyzing the conversion error and its propagation through layers theoretically, we propose the calibration algorithm that can correct the error layer by layer. The calibration only takes a handful number of training data and several minutes to finish. Moreover, our calibration algorithm can produce SNN with state of the art architecture on the large scale ImageNet dataset, including MobileNet and RegNet. Extensive experiments demonstrate the effectiveness and efficiency of our algorithm. For example, our advanced pipeline can increase up to 69 top 1 accuracy when converting MobileNet on ImageNet compared to baselines. Codes are released at https github.com yhhhli SNN Calibration.


Few Data Guided Learning Upon End to End Point Cloud Network for 3D Face Recognition. 3D face recognition has shown its potential in many application scenarios. Among numerous 3D face recognition methods, deep learning based methods have developed vigorously in recent years. In this paper, an end to end deep learning network entitled Sur3dNet Face for point cloud based 3D face recognition is proposed. The network uses PointNet as the backbone, which is a successful point cloud classification solution but does not work properly in face recognition. Supplemented with modifications in network architecture and a few data guided learning framework based on Gaussian process morphable model, the backbone is successfully modified for 3D face recognition. Different from existing methods training with a large amount of data in multiple datasets, our method uses Spring2003 subset of FRGC v2.0 for training which contains only 943 facial scans, and the network is well trained with the guidance of such a small amount of real data. Without fine tuning on the test set, the Rank 1 Recognition Rate (RR1) is achieved as follows 98.85 on FRGC v2.0 dataset and 99.33 on Bosphorus dataset, which proves the effectiveness and the potentiality of our method.


Aspect based Sentiment Analysis in Document FOMC Meeting Minutes on Economic Projection. The Federal Open Market Committee within the Federal Reserve System is responsible for managing inflation, maximizing employment, and stabilizing interest rates. Meeting minutes play an important role for market movements because they provide the birds eye view of how this economic complexity is constantly re weighed. Therefore, There has been growing interest in analyzing and extracting sentiments on various aspects from large financial texts for economic projection. However, Aspect based Sentiment Analysis is not widely used on financial data due to the lack of large labeled dataset. In this paper, I propose a model to train ABSA on financial documents under weak supervision and analyze its predictive power on various macroeconomic indicators.


Domain matched Pre training Tasks for Dense Retrieval. Pre training on larger datasets with ever increasing model size is now a proven recipe for increased performance across almost all NLP tasks. A notable exception is information retrieval, where additional pre training has so far failed to produce convincing results. We show that, with the right pre training setup, this barrier can be overcome. We demonstrate this by pre training large bi encoder models on 1) a recently released set of 65 million synthetically generated questions, and 2) 200 million post comment pairs from a preexisting dataset of Reddit conversations made available by pushshift.io. We evaluate on a set of information retrieval and dialogue retrieval benchmarks, showing substantial improvements over supervised baselines.


A Survey on Concept Drift in Process Mining. Concept drift in process mining (PM) is a challenge as classical methods assume processes are in a steady state, i.e., events share the same process version. We conducted a systematic literature review on the intersection of these areas, and thus, we review concept drift in process mining and bring forward a taxonomy of existing techniques for drift detection and online process mining for evolving environments. Existing works depict that (i) PM still primarily focuses on offline analysis, and (ii) the assessment of concept drift techniques in processes is cumbersome due to the lack of common evaluation protocol, datasets, and metrics.


Can Transfer Neuroevolution Tractably Solve Your Differential Equations?. This paper introduces neuroevolution for solving differential equations. The solution is obtained through optimizing a deep neural network whose loss function is defined by the residual terms from the differential equations. Recent studies have focused on learning such physics informed neural networks through stochastic gradient descent (SGD) variants, yet they face the difficulty of obtaining an accurate solution due to optimization challenges. In the context of solving differential equations, we are faced with the problem of finding globally optimum parameters of the network, instead of being concerned with out of sample generalization. SGD, which searches along a single gradient direction, is prone to become trapped in local optima, so it may not be the best approach here. In contrast, neuroevolution carries out a parallel exploration of diverse solutions with the goal of circumventing local optima. It could potentially find more accurate solutions with better optimized neural networks. However, neuroevolution can be slow, raising tractability issues in practice. With that in mind, a novel and computationally efficient transfer neuroevolution algorithm is proposed in this paper. Our method is capable of exploiting relevant experiential priors when solving a new problem, with adaptation to protect against the risk of negative transfer. The algorithm is applied on a variety of differential equations to empirically demonstrate that transfer neuroevolution can indeed achieve better accuracy and faster convergence than SGD. The experimental outcomes thus establish transfer neuroevolution as a noteworthy approach for solving differential equations, one that has never been studied in the past. Our work expands the resource of available algorithms for optimizing physics informed neural networks.


Insula Interoception, Active Inference and Feeling Representation. The body sends interoceptive visceral information through deep brain structures to the cerebral cortex. The insula cortex, organized in hierarchical modules, is the major cortical region receiving interoceptive afferents and contains visceral topographic maps. Yet, the biological significance of the insula's modular architecture in relation to deep brain regions remains unsolved. In this opinion, we propose the Insula Hierarchical Modular Adaptive Interoception Control (IMAC) model to suggest that insula modules (granular, dysgranular and agranular subregions), forming networks with prefrontal (supplementary motor area, dorsolateral and ventromedial cortices) and striatum (posterior, dorsomedial and ventromedial) subregions, are specialized for higher order interoceptive representations, recruited in a context dependent manner to support habitual, model based and exploratory adaptive behavior. We then discuss how insula interoceptive representations, or metaceptions, could give rise to conscious interoceptive feelings built up from low order visceral representations and associated basic emotions located in deep interoceptive brain structures.


If you trust me, I will trust you the role of reciprocity in human robot trust. Trust is fundamental in human human and human robot interaction. Extensive evidence has shown that trust among humans is sustained by reciprocity, whereas knowledge on reciprocal dynamics of trust in human robot interaction is very limited. To investigate reciprocity in human robot trust, we designed a joint task in which a human participant and a humanoid robot made perceptual judgments while signaling their trust in the partner. The robot's trust was dynamically manipulated along the experiment. Results show that participants were less willing to learn from a robot that was showing high trust in them. However, participants were unwilling to overtly disclose their distrust to the robot if they expected future interactions with it, suggesting the emergence of reciprocity in their overt expression of trust. Importantly, these effects disappeared when participants interacted with a computer. Our findings may have an impact on the design of robots that could effectively collaborate with humans.


UHP SOT An Unsupervised High Performance Single Object Tracker. An unsupervised online object tracking method that exploits both foreground and background correlations is proposed and named UHP SOT (Unsupervised High Performance Single Object Tracker) in this work. UHP SOT consists of three modules 1) appearance model update, 2) background motion modeling, and 3) trajectory based box prediction. A state of the art discriminative correlation filters (DCF) based tracker is adopted by UHP SOT as the first module. We point out shortcomings of using the first module alone such as failure in recovering from tracking loss and inflexibility in object box adaptation and then propose the second and third modules to overcome them. Both are novel in single object tracking (SOT). We test UHP SOT on two popular object tracking benchmarks, TB 50 and TB 100, and show that it outperforms all previous unsupervised SOT methods, achieves a performance comparable with the best supervised deep learning based SOT methods, and operates at a fast speed (i.e. 22.7 32.0 FPS on a CPU).


EscapeWildFire Assisting People to Escape Wildfires in Real Time. Over the past couple of decades, the number of wildfires and area of land burned around the world has been steadily increasing, partly due to climatic changes and global warming. Therefore, there is a high probability that more people will be exposed to and endangered by forest fires. Hence there is an urgent need to design pervasive systems that effectively assist people and guide them to safety during wildfires. This paper presents EscapeWildFire, a mobile application connected to a backend system which models and predicts wildfire geographical progression, assisting citizens to escape wildfires in real time. A small pilot indicates the correctness of the system. The code is open source fire authorities around the world are encouraged to adopt this approach.


Calculation of Electric Quadrupole Linestrengths for Diatomic Molecules Application to the H2, CO, HF and O2 Molecules. We present a unified variational treatment of the electric quadrupole (E2) matrix elements, Einstein coefficients, and line strengths for general open shell diatomic molecules in the general purpose diatomic code Duo. Transformation relations between the Cartesian representation (typically used in electronic structure calculations) to the tensorial representation (required for spectroscopic applications) of the electric quadrupole moment components are derived. The implementation has been validated against accurate theoretical calculations and experimental measurements of quadrupole intensities of 1 text H 2 available in the literature. We also present accurate electronic structure calculations of the electric quadrupole moment functions for the X 1 Sigma electronic states of text CO and text HF at the CCSD(T) and MRCI levels of theory, respectively, as well for the a 1 Delta g b 1 Sigma g quadrupole transition moment of text O 2 with MRCI level of theory. Accurate infrared E2 line lists for 12 text C 16 text O and 1 text H 19 text F are provided. A demonstration of spectroscopic applications is presented by simulating E2 spectra for 12 text C 16 text O , text H 19 text F and 16 text O 2 (Noxon a 1 Delta g b 1 Sigma g band).


H3D Net Few Shot High Fidelity 3D Head Reconstruction. Recent learning approaches that implicitly represent surface geometry using coordinate based neural representations have shown impressive results in the problem of multi view 3D reconstruction. The effectiveness of these techniques is, however, subject to the availability of a large number (several tens) of input views of the scene, and computationally demanding optimizations. In this paper, we tackle these limitations for the specific problem of few shot full 3D head reconstruction, by endowing coordinate based representations with a probabilistic shape prior that enables faster convergence and better generalization when using few input images (down to three). First, we learn a shape model of 3D heads from thousands of incomplete raw scans using implicit representations. At test time, we jointly overfit two coordinate based neural networks to the scene, one modeling the geometry and another estimating the surface radiance, using implicit differentiable rendering. We devise a two stage optimization strategy in which the learned prior is used to initialize and constrain the geometry during an initial optimization phase. Then, the prior is unfrozen and fine tuned to the scene. By doing this, we achieve high fidelity head reconstructions, including hair and shoulders, and with a high level of detail that consistently outperforms both state of the art 3D Morphable Models methods in the few shot scenario, and non parametric methods when large sets of views are available.


Symmetry Breaking in Plant Stems. The purpose of this paper is to present a model of a phenomenon of plant stem morphogenesis observed by Cesar Gomez Campo in 1970. We consider a simplified model of auxin dynamics in plant stems, showing that, after creation of the original primordium, it can represent random, distichous and spiral phyllotaxis (leaf arrangement) just by varying one parameter, the rate of diffusion. The same analysis extends to the n jugate case where n primordia are initiated at each plastochrone. Having validated the model, we consider how it can give rise to the Gomez Campo phenomenon, showing how a stem with spiral phyllotaxis can produce branches of the same or opposite chirality. And finally, how the relationship can change from discordant to concordant over the course of a growing season.


AuctionWhisk Using an Auction Inspired Approach for Function Placement in Serverless Fog Platforms. The Function as a Service (FaaS) paradigm has a lot of potential as a computing model for fog environments comprising both cloud and edge nodes, as compute requests can be scheduled across the entire fog continuum in a fine grained manner. When the request rate exceeds capacity limits at the resource constrained edge, some functions need to be offloaded towards the cloud. In this paper, we present an auction inspired approach in which application developers bid on resources while fog nodes decide locally which functions to execute and which to offload in order to maximize revenue. Unlike many current approaches to function placement in the fog, our approach can work in an online and decentralized manner. We also present our proof of concept prototype AuctionWhisk that illustrates how such an approach can be implemented in a real FaaS platform. Through a number of simulation runs and system experiments, we show that revenue for overloaded nodes can be maximized without dropping function requests.


Towards A Conceptually Simple Defensive Approach for Few shot classifiers Against Adversarial Support Samples. Few shot classifiers have been shown to exhibit promising results in use cases where user provided labels are scarce. These models are able to learn to predict novel classes simply by training on a non overlapping set of classes. This can be largely attributed to the differences in their mechanisms as compared to conventional deep networks. However, this also offers new opportunities for novel attackers to induce integrity attacks against such models, which are not present in other machine learning setups. In this work, we aim to close this gap by studying a conceptually simple approach to defend few shot classifiers against adversarial attacks. More specifically, we propose a simple attack agnostic detection method, using the concept of self similarity and filtering, to flag out adversarial support sets which destroy the understanding of a victim classifier for a certain class. Our extended evaluation on the miniImagenet (MI) and CUB datasets exhibit good attack detection performance, across three different few shot classifiers and across different attack strengths, beating baselines. Our observed results allow our approach to establishing itself as a strong detection method for support set poisoning attacks. We also show that our approach constitutes a generalizable concept, as it can be paired with other filtering functions. Finally, we provide an analysis of our results when we vary two components found in our detection approach.


Underwater Soft Robotic Hand with Multi Source Coupling Bio Inspired Soft Palm and Six Fingers Driven by Water Hydraulic. A new fluid driven soft robot hand in this study uses the idea of the bionics and has the anthropomorphic form, which is oriented to the flexible grasp function. The soft robot hand is composed of a new kind of multi freedom soft finger and soft palm, which realizes the characteristic grasping function of forehand and backhand. Combined with the fine fluid control system, the soft hand can realize flexible grasping under high pressure, so as to realize flexible grasping operation for different types of target objects in the underwater environment. The soft robot hand was controlled based on water hydraulic platform, Finally, the soft robot hand and the fine fluid control system were connected to form the underwater soft robot hand experiment platform.


On State Estimation for Legged Locomotion over Soft Terrain. Locomotion over soft terrain remains a challenging problem for legged robots. Most of the work done on state estimation for legged robots is designed for rigid contacts, and does not take into account the physical parameters of the terrain. That said, this letter answers the following questions how and why does soft terrain affect state estimation for legged robots? To do so, we utilized a state estimator that fuses IMU measurements with leg odometry that is designed with rigid contact assumptions. We experimentally validated the state estimator with the HyQ robot trotting over both soft and rigid terrain. We demonstrate that soft terrain negatively affects state estimation for legged robots, and that the state estimates have a noticeable drift over soft terrain compared to rigid terrain.


Solving String Constraints With Regex Dependent Functions Through Transducers With Priorities And Variables. Regular expressions are a classical concept in formal language theory. Regular expressions in programming languages (RegEx) such as JavaScript, feature non standard semantics of operators (e.g. greedy lazy Kleene star), as well as additional features such as capturing groups and references. While symbolic execution of programs containing RegExes appeals to string solvers natively supporting important features of RegEx, such a string solver is hitherto missing. In this paper, we propose the first string theory and string solver that natively provide such a support. The key idea of our string solver is to introduce a new automata model, called prioritized streaming string transducers (PSST), to formalize the semantics of RegEx dependent string functions. PSSTs combine priorities, which have previously been introduced in prioritized finite state automata to capture greedy lazy semantics, with string variables as in streaming string transducers to model capturing groups. We validate the consistency of the formal semantics with the actual JavaScript semantics by extensive experiments. Furthermore, to solve the string constraints, we show that PSSTs enjoy nice closure and algorithmic properties, in particular, the regularity preserving property (i.e., pre images of regular constraints under PSSTs are regular), and introduce a sound sequent calculus that exploits these properties and performs propagation of regular constraints by means of taking post images or pre images. Although the satisfiability of the string constraint language is undecidable, we show that our approach is complete for the so called straight line fragment. We evaluate the performance of our string solver on over 195000 string constraints generated from an open source RegEx library. The experimental results show the efficacy of our approach, drastically improving the existing methods in both precision and efficiency.


TreeBERT A Tree Based Pre Trained Model for Programming Language. Source code can be parsed into the abstract syntax tree (AST) based on defined syntax rules. However, in pre training, little work has considered the incorporation of tree structure into the learning process. In this paper, we present TreeBERT, a tree based pre trained model for improving programming language oriented generation tasks. To utilize tree structure, TreeBERT represents the AST corresponding to the code as a set of composition paths and introduces node position embedding. The model is trained by tree masked language modeling (TMLM) and node order prediction (NOP) with a hybrid objective. TMLM uses a novel masking strategy designed according to the tree's characteristics to help the model understand the AST and infer the missing semantics of the AST. With NOP, TreeBERT extracts the syntactical structure by learning the order constraints of nodes in AST. We pre trained TreeBERT on datasets covering multiple programming languages. On code summarization and code documentation tasks, TreeBERT outperforms other pre trained models and state of the art models designed for these tasks. Furthermore, TreeBERT performs well when transferred to the pre trained unseen programming language.


Estimates of p harmonic functions in planar sectors. Suppose that p in (1, infty , v in 1 2, infty) and mathcal S v left (x, y) in mathbb R 2 setminus (0, 0) phi frac pi 2v right , where phi is the polar angle of (x,y) . Let R 0 and omega p(x) be the p harmonic measure of partial B(0,R) cap mathcal S v at x with respect to B(0, R) cap mathcal S v . We prove that there exists a constant C such that begin align C 1 left( frac x R right) k(v,p) , leq omega p(x) , leq C left( frac x R right) k(v,p) end align where the exponent k(v,p) is given explicitly as a function of v and p . Using this estimate we derive local growth estimates for p sub and p superharmonic functions in planar domains which are locally approximable by sectors, e.g., we conclude bounds of the rate of convergence near the boundary where the domain has an inwardly or outwardly pointed cusp. Using the estimates of p harmonic measure we also derive a sharp Phragmen Lindel "of theorem for p subharmonic functions in the unbounded sector mathcal S v . Moreover, if p infty then the above mentioned estimates extend from the setting of two dimensional sectors to cones in mathbb R n . Finally, when v in (1 2, infty) and p in (1, infty) we prove a uniqueness result (modulo normalization) for positive p harmonic functions in mathcal S v vanishing on partial mathcal S v .


Bubble dynamics in Liquid Hole Multipliers. In bubble assisted Liquid HoleMultipliers(LHM), developed for noble liquid radiation detectors, the stability of the bubble and the electro mechanical properties of the liquid to gas interface play a dominant role in the detector performance. A model is proposed to evaluate the static equilibrium configurations of a bubble sustained underneath a perforated electrode immersed in a liquid. For the first time bubbles were optically observed in LAr their properties were studied in contact with different material surfaces. This permitted investigating the bubble electrodynamics via numerical simulations it was shown that the electric field acts as an additional pressure term on the bubble meniscus. The predictions for the liquid to gas interface were successfully validated using X ray micro CT in water and in silicone oil at STP. The proposed model and the results of this study are an important milestone towards understanding and optimizing the parameters of LHM based noble liquid detectors.


Relation aware Hierarchical Attention Framework for Video Question Answering. Video Question Answering (VideoQA) is a challenging video understanding task since it requires a deep understanding of both question and video. Previous studies mainly focus on extracting sophisticated visual and language embeddings, fusing them by delicate hand crafted networks. However, the relevance of different frames, objects, and modalities to the question are varied along with the time, which is ignored in most of existing methods. Lacking understanding of the the dynamic relationships and interactions among objects brings a great challenge to VideoQA task. To address this problem, we propose a novel Relation aware Hierarchical Attention (RHA) framework to learn both the static and dynamic relations of the objects in videos. In particular, videos and questions are embedded by pre trained models firstly to obtain the visual and textual features. Then a graph based relation encoder is utilized to extract the static relationship between visual objects. To capture the dynamic changes of multimodal objects in different video frames, we consider the temporal, spatial, and semantic relations, and fuse the multimodal features by hierarchical attention mechanism to predict the answer. We conduct extensive experiments on a large scale VideoQA dataset, and the experimental results demonstrate that our RHA outperforms the state of the art methods.


Guidance and Teaching Network for Video Salient Object Detection. Owing to the difficulties of mining spatial temporal cues, the existing approaches for video salient object detection (VSOD) are limited in understanding complex and noisy scenarios, and often fail in inferring prominent objects. To alleviate such shortcomings, we propose a simple yet efficient architecture, termed Guidance and Teaching Network (GTNet), to independently distil effective spatial and temporal cues with implicit guidance and explicit teaching at feature and decision level, respectively. To be specific, we (a) introduce a temporal modulator to implicitly bridge features from motion into the appearance branch, which is capable of fusing cross modal features collaboratively, and (b) utilise motion guided mask to propagate the explicit cues during the feature aggregation. This novel learning strategy achieves satisfactory results via decoupling the complex spatial temporal cues and mapping informative cues across different modalities. Extensive experiments on three challenging benchmarks show that the proposed method can run at 28 fps on a single TITAN Xp GPU and perform competitively against 14 cutting edge baselines.


Transverse Ultrafast Laser Inscription in Bulk Silicon. In volume ultrafast laser direct writing of silicon is generally limited by strong nonlinear propagation effects preventing the initiation of modifications. By employing a triple optimization procedure in the spectral, temporal and spatial domains, we demonstrate that modifications can be repeatably produced inside silicon. Our approach relies on irradiation at approx 2 mu m wavelength with temporally distorted femtosecond pulses. These pulses are focused in a way that spherical aberrations of different origins counterbalance, as predicted by point spread function analyses and in good agreement with nonlinear propagation simulations. We also establish the laws governing modification growth on a pulse to pulse basis, which allows us to demonstrate transverse inscription inside silicon with various line morphologies depending on the irradiation conditions. We finally show that the production of single pulse repeatable modifications is a necessary condition for reliable transverse inscription inside silicon.


Quadratic Residual Networks A New Class of Neural Networks for Solving Forward and Inverse Problems in Physics Involving PDEs. We propose quadratic residual networks (QRes) as a new type of parameter efficient neural network architecture, by adding a quadratic residual term to the weighted sum of inputs before applying activation functions. With sufficiently high functional capacity (or expressive power), we show that it is especially powerful for solving forward and inverse physics problems involving partial differential equations (PDEs). Using tools from algebraic geometry, we theoretically demonstrate that, in contrast to plain neural networks, QRes shows better parameter efficiency in terms of network width and depth thanks to higher non linearity in every neuron. Finally, we empirically show that QRes shows faster convergence speed in terms of number of training epochs especially in learning complex patterns.


Variational Auto Encoder Gradient Clustering. Clustering using deep neural network models have been extensively studied in recent years. Among the most popular frameworks are the VAE and GAN frameworks, which learns latent feature representations of data through encoder decoder neural net structures. This is a suitable base for clustering tasks, as the latent space often seems to effectively capture the inherent essence of data, simplifying its manifold and reducing noise. In this article, the VAE framework is used to investigate how probability function gradient ascent over data points can be used to process data in order to achieve better clustering. Improvements in classification is observed comparing with unprocessed data, although state of the art results are not obtained. Processing data with gradient descent however results in more distinct cluster separation, making it simpler to investigate suitable hyper parameter settings such as the number of clusters. We propose a simple yet effective method for investigating suitable number of clusters for data, based on the DBSCAN clustering algorithm, and demonstrate that cluster number determination is facilitated with gradient processing. As an additional curiosity, we find that our baseline model used for comparison a GMM on a t SNE latent space for a VAE structure with weight one on reconstruction during training (autoencoder), yield state of the art results on the MNIST data, to our knowledge not beaten by any other existing model.


Evaluating participants' experience of extended interaction with cutting edge physics research through the PRiSE 'research in schools' programme. Physics in schools is distinctly different from, and struggles to capture the excitement of, university research level work. Initiatives where students engage in independent research linked to cutting edge physics within their school over several months might help mitigate this, potentially facilitating the uptake of science in higher education. However, how such initiatives are best supported remains unclear and understudied. This paper evaluates a provision framework, Physics Research in School Environments' (PRiSE), using survey data from participating 14 18 year old students and their teachers to understand their experience of the programme. The results show that PRiSE appears to provide much more positive experiences than typical university outreach initiatives due to the nature of the opportunities afforded over several months, which schools would not be able to provide without external input. The intensive support offered is deemed necessary, with all elements appearing equally important. Based on additional feedback from independent researchers and engagement professionals, we also suggest the framework could be adopted at other institutions and applied to their own areas of scientific research, something which has already started to occur.


Stable representation theory beyond the classical groups. The orthogonal groups are a series of simple Lie groups associated to symmetric bilinear forms. There is no analogous series associated to symmetric trilinear forms. We introduce an infinite dimensional group like object that can be viewed as the limit of this non existent series, were it to exist. We show that the representation theory of this object is well behaved, and similar to the stable representation theory of orthogonal groups. Our theory is not specific to symmetric trilinear forms, and applies to any kind of tensorial forms. Our results can be also be viewed from the perspective of semi linear representations of the infinite general linear group, and are closely related to twisted commutative algebras.


Robust Maximum Entropy Behavior Cloning. Imitation learning (IL) algorithms use expert demonstrations to learn a specific task. Most of the existing approaches assume that all expert demonstrations are reliable and trustworthy, but what if there exist some adversarial demonstrations among the given data set? This may result in poor decision making performance. We propose a novel general frame work to directly generate a policy from demonstrations that autonomously detect the adversarial demonstrations and exclude them from the data set. At the same time, it's sample, time efficient, and does not require a simulator. To model such adversarial demonstration we propose a min max problem that leverages the entropy of the model to assign weights for each demonstration. This allows us to learn the behavior using only the correct demonstrations or a mixture of correct demonstrations.


Cross SEAN A Cross Stitch Semi Supervised Neural Attention Model for COVID 19 Fake News Detection. As the COVID 19 pandemic sweeps across the world, it has been accompanied by a tsunami of fake news and misinformation on social media. At the time when reliable information is vital for public health and safety, COVID 19 related fake news has been spreading even faster than the facts. During times such as the COVID 19 pandemic, fake news can not only cause intellectual confusion but can also place lives of people at risk. This calls for an immediate need to contain the spread of such misinformation on social media. We introduce CTF, the first COVID 19 Twitter fake news dataset with labeled genuine and fake tweets. Additionally, we propose Cross SEAN, a cross stitch based semi supervised end to end neural attention model, which leverages the large amount of unlabelled data. Cross SEAN partially generalises to emerging fake news as it learns from relevant external knowledge. We compare Cross SEAN with seven state of the art fake news detection methods. We observe that it achieves 0.95 F1 Score on CTF, outperforming the best baseline by 9 . We also develop Chrome SEAN, a Cross SEAN based chrome extension for real time detection of fake tweets.


High responsivity, High detectivity Photomultiplication Organic Photodetector Realized by a Metal Insulator Semiconductor Tunneling Junction. Organic photodetectors (OPDs) possess bright prospects in applications of medical imaging and wearable electronics due to the advantages such as low cost, good biocompatibility, and good flexibility. Photomultiplication OPDs (PM OPDs) enabled by the trap assisted carrier tunneling injection effect exhibit external quantum efficiencies far greater than unity, thus the acquired responsivities are extremely high. However, the reported PM OPDs with high responsivity performances are all accompanied by high dark currents due to the introduction of carrier traps, which inevitably results in inferior detectivities. In this work, we modify a P3HT PCBM donor rich PM OPD by introducing an atomically thin Al2O3 interfacial layer through the ALD technique, obtaining a high responsivity of 8294 A W and high detectivity of 6.76 10 14 Jones, simultaneously, both of which are among the highest reported for bulk heterojunction PM OPDs. Ascribed to the introduction of the atomically thin Al2O3 layer, the metal insulator semiconductor (MIS) tunneling junction is formed, which brings forward a suppressed dark current along with an increased amounts of holes tunneling under forward bias. Meanwhile, the weak light detection limit of the modified PM OPD within the linear response range reaches the level of nW cm2. Based on the proposed PM OPD, a proof of concept image sensor with 26 26 pixels is demonstrated, which can respond to both ultraviolet light and visible light. The PM OPD based sensor arrays can find broad applications for medical imaging, wearable electronics, etc.


The Care Label Concept A Certification Suite for Trustworthy and Resource Aware Machine Learning. Machine learning applications have become ubiquitous. This has led to an increased effort of making machine learning trustworthy. Explainable and fair AI have already matured. They address knowledgeable users and application engineers. For those who do not want to invest time into understanding the method or the learned model, we offer care labels easy to understand at a glance, allowing for method or model comparisons, and, at the same time, scientifically well based. On one hand, this transforms descriptions as given by, e.g., Fact Sheets or Model Cards, into a form that is well suited for end users. On the other hand, care labels are the result of a certification suite that tests whether stated guarantees hold. In this paper, we present two experiments with our certification suite. One shows the care labels for configurations of Markov random fields (MRFs). Based on the underlying theory of MRFs, each choice leads to its specific rating of static properties like, e.g., expressivity and reliability. In addition, the implementation is tested and resource consumption is measured yielding dynamic properties. This two level procedure is followed by another experiment certifying deep neural network (DNN) models. There, we draw the static properties from the literature on a particular model and data set. At the second level, experiments are generated that deliver measurements of robustness against certain attacks. We illustrate this by ResNet 18 and MobileNetV3 applied to ImageNet.


A Reinforcement Learning Environment for Polyhedral Optimizations. The polyhedral model allows a structured way of defining semantics preserving transformations to improve the performance of a large class of loops. Finding profitable points in this space is a hard problem which is usually approached by heuristics that generalize from domain expert knowledge. Existing problem formulations in state of the art heuristics depend on the shape of particular loops, making it hard to leverage generic and more powerful optimization techniques from the machine learning domain. In this paper, we propose PolyGym, a shape agnostic formulation for the space of legal transformations in the polyhedral model as a Markov Decision Process (MDP). Instead of using transformations, the formulation is based on an abstract space of possible schedules. In this formulation, states model partial schedules, which are constructed by actions that are reusable across different loops. With a simple heuristic to traverse the space, we demonstrate that our formulation is powerful enough to match and outperform state of the art heuristics. On the Polybench benchmark suite, we found transformations that led to a speedup of 3.39x over LLVM O3, which is 1.83x better than the speedup achieved by ISL. Our generic MDP formulation enables using reinforcement learning to learn optimization policies over a wide range of loops. This also contributes to the emerging field of machine learning in compilers, as it exposes a novel problem formulation that can push the limits of existing methods.


Editing a classifier by rewriting its prediction rules. We present a methodology for modifying the behavior of a classifier by directly rewriting its prediction rules. Our approach requires virtually no additional data collection and can be applied to a variety of settings, including adapting a model to new environments, and modifying it to ignore spurious features. Our code is available at https github.com MadryLab EditingClassifiers .


Fast and Real time End to End Control in Autonomous Racing Cars Through Representation Learning. The challenges presented in an autonomous racing situation are distinct from those faced in regular autonomous driving and require faster end to end algorithms and consideration of a longer horizon in determining optimal current actions keeping in mind upcoming maneuvers and situations. In this paper, we propose an end to end method for autonomous racing that takes in as inputs video information from an onboard camera and determines final steering and throttle control actions. We use the following split to construct such a method (1) learning a low dimensional representation of the scene, (2) pre generating the optimal trajectory for the given scene, and (3) tracking the predicted trajectory using a classical control method. In learning a low dimensional representation of the scene, we use intermediate representations with a novel unsupervised trajectory planner to generate expert trajectories, and hence utilize them to directly predict race lines from a given front facing input image. Thus, the proposed algorithm employs the best of two worlds the robustness of learning based approaches to perception and the accuracy of optimization based approaches for trajectory generation in an end to end learning based framework. We deploy and demonstrate our framework on CARLA, a photorealistic simulator for testing self driving cars in realistic environments.


An eXtended Finite Element Method Implementation in COMSOL Multiphysics Solid Mechanics. This paper presents the first time implementation of the eXtended Finite Element Method (XFEM) in the general purpose commercial software COMSOL Multiphysics. An enrichment strategy is proposed, consistent with the structure of the software. To this end, for each set of enrichment functions, an additional Solid Mechanics module is incorporated into the numerical framework, coupled with compatible modifications to the internal variables. The Linear Elastic Fracture Mechanics (LEFM) is exclusively adopted for the crack analysis. The model pre processing, level set update, stress intensity factor calculation and crack propagation analysis are conducted by employing COMSOL's built in features in conjunction with external MATLAB functions through COMSOL LiveLink. All implementational aspects and suggested remedies for the treatment of enriched elements, framework setup, evaluation of stress intensity factors, and numerical integration are described in detail. The accuracy and robustness of the proposed method are examined by several numerical examples for stationary and propagating crack problems in 2D and 3D settings. The results represent excellent agreement with available analytical, numerical and experimental observations in the literature. Keywords XFEM COMSOL Multiphysics Crack analysis Fracture propagation


Mono elemental saturable absorber in mode locked fiber laser A review. Two dimensional mono elemental material is an excellent saturable absorber candidate with low saturation intensity, large modulation depth, high nonlinearities, and fast recovery time of excited carriers. Typically, these mono elemental material with two dimensional structure possesses tunable bandgap from metallic to semiconducting according to different number of layers. The successful application of these materials as the saturable absorber has exploited the development of mode locked fiber lasers. Therefore, this review is intended to provide an up to date information to the development of mono elemental saturable absorber for the advances in mode locked fiber laser, with emphasis on their material properties, synthesis process and material characterization. Meanwhile, issues and challenges of the review research topic will be highlighted and addressed with several concrete recommendations.


Generalized Cline's formula and Jacobson's lemma in a ring. We present new generalized Cline's formula and Jacobson's lemma for the g Drazin inverse in a ring. These extend many known results, e.g., Chen and Abdolyousefi (Generalized Jacobson's Lemma in a Banach algebra, Comm. Algebra, bf 49 (2021), 3263 3272), Yan and Zeng (The generalized inverses of the products of two elements in a ring, Turk. J. Math., bf 44 (2020), 1744 1756).