RetrievalSum A Retrieval Enhanced Framework for Abstractive Summarization. Existing summarization systems mostly generate summaries purely relying on the content of the source document. However, even for humans, we usually need some references or exemplars to help us fully understand the source document and write summaries in a particular format. But how to find the high quality exemplars and incorporate them into summarization systems is still challenging and worth exploring. In this paper, we propose RetrievalSum, a novel retrieval enhanced abstractive summarization framework consisting of a dense Retriever and a Summarizer. At first, several closely related exemplars are retrieved as supplementary input to help the generation model understand the text more comprehensively. Furthermore, retrieved exemplars can also play a role in guiding the model to capture the writing style of a specific corpus. We validate our method on a wide range of summarization datasets across multiple domains and two backbone models BERT and BART. Results show that our framework obtains significant improvement by 1.38 4.66 in ROUGE 1 score when compared with the powerful pre trained models, and achieve new state of the art on BillSum. Human evaluation demonstrates that our retrieval enhanced model can better capture the domain specific writing style.


Asymmetric CNN for image super resolution. Deep convolutional neural networks (CNNs) have been widely applied for low level vision over the past five years. According to nature of different applications, designing appropriate CNN architectures is developed. However, customized architectures gather different features via treating all pixel points as equal to improve the performance of given application, which ignores the effects of local power pixel points and results in low training efficiency. In this paper, we propose an asymmetric CNN (ACNet) comprising an asymmetric block (AB), a memory enhancement block (MEB) and a high frequency feature enhancement block (HFFEB) for image super resolution. The AB utilizes one dimensional asymmetric convolutions to intensify the square convolution kernels in horizontal and vertical directions for promoting the influences of local salient features for SISR. The MEB fuses all hierarchical low frequency features from the AB via residual learning (RL) technique to resolve the long term dependency problem and transforms obtained low frequency features into high frequency features. The HFFEB exploits low and high frequency features to obtain more robust super resolution features and address excessive feature enhancement problem. Addditionally, it also takes charge of reconstructing a high resolution (HR) image. Extensive experiments show that our ACNet can effectively address single image super resolution (SISR), blind SISR and blind SISR of blind noise problems. The code of the ACNet is shown at https github.com hellloxiaotian ACNet.


Channel Wise Attention Based Network for Self Supervised Monocular Depth Estimation. Self supervised learning has shown very promising results for monocular depth estimation. Scene structure and local details both are significant clues for high quality depth estimation. Recent works suffer from the lack of explicit modeling of scene structure and proper handling of details information, which leads to a performance bottleneck and blurry artefacts in predicted results. In this paper, we propose the Channel wise Attention based Depth Estimation Network (CADepth Net) with two effective contributions 1) The structure perception module employs the self attention mechanism to capture long range dependencies and aggregates discriminative features in channel dimensions, explicitly enhances the perception of scene structure, obtains the better scene understanding and rich feature representation. 2) The detail emphasis module re calibrates channel wise feature maps and selectively emphasizes the informative features, aiming to highlight crucial local details information and fuse different level features more efficiently, resulting in more precise and sharper depth prediction. Furthermore, the extensive experiments validate the effectiveness of our method and show that our model achieves the state of the art results on the KITTI benchmark and Make3D datasets.


Level and Gorenstein Projective Dimension. We investigate the relationship between the level of a bounded complex over a commutative ring with respect to the class of Gorenstein projective modules and other invariants of the complex or ring, such as projective dimension, Gorenstein projective dimension, and Krull dimension. The results build upon work done by J. Christensen 6 , H. Altmann et al. 1 , and Avramov et al. 3 for levels with respect to the class of finitely generated projective modules.


Typing Errors in Factual Knowledge Graphs Severity and Possible Ways Out. Factual knowledge graphs (KGs) such as DBpedia and Wikidata have served as part of various downstream tasks and are also widely adopted by artificial intelligence research communities as benchmark datasets. However, we found these KGs to be surprisingly noisy. In this study, we question the quality of these KGs, where the typing error rate is estimated to be 27 for coarse grained types on average, and even 73 for certain fine grained types. In pursuit of solutions, we propose an active typing error detection algorithm that maximizes the utilization of both gold and noisy labels. We also comprehensively discuss and compare unsupervised, semi supervised, and supervised paradigms to deal with typing errors in factual KGs. The outcomes of this study provide guidelines for researchers to use noisy factual KGs. To help practitioners deploy the techniques and conduct further research, we published our code and data.


Polar degree of hypersurfaces with 1 dimensional singularities. We prove a formula for the polar degree of projective hypersurfaces in terms of the Milnor data of the singularities, extending to 1 dimensional singularities the Dimca Papadima result for isolated singularities. We discuss the semi continuity of the polar degree in deformations, and we classify the homaloidal cubic surfaces with 1 dimensional singular locus. Some open questions are pointed out along the way.


On the Erroneous Correlation between Earthquakes and Eclipses. A long lasting belief is that the gravitational stress by the moon would be responsible for earthquakes because of causing a tidal deformation of Earth's crust. Even worse, earthquakes are sometimes said to be correlated with eclipses. We review the origin of this wrong statement and show that the idea is owed to a fallacious perception of coincidence. In ancient times the two catastrophes were linked interpreting the announcement of Doomsday, while in modern times a quasi scientific essay disseminated such an interrelation shortly before the theory of tectonics.


CAPE Encoding Relative Positions with Continuous Augmented Positional Embeddings. Without positional information, attention based Transformer neural networks are permutation invariant. Absolute or relative positional embeddings are the most popular ways to feed Transformer models with positional information. Absolute positional embeddings are simple to implement, but suffer from generalization issues when evaluating on sequences longer than seen at training time. Relative positions are more robust to input length change, but are more complex to implement and yield inferior model throughput due to extra computational and memory costs. In this paper, we propose an augmentation based approach (CAPE) for absolute positional embeddings, which keeps the advantages of both absolute (simplicity and speed) and relative positional embeddings (better generalization). In addition, our empirical evaluation on state of the art models in machine translation, image and speech recognition demonstrates that CAPE leads to better generalization performance as well as increased stability with respect to training hyper parameters.


Architecture Specific Performance Optimization of Compute Intensive FaaS Functions. FaaS allows an application to be decomposed into functions that are executed on a FaaS platform. The FaaS platform is responsible for the resource provisioning of the functions. Recently, there is a growing trend towards the execution of compute intensive FaaS functions that run for several seconds. However, due to the billing policies followed by commercial FaaS offerings, the execution of these functions can incur significantly higher costs. Moreover, due to the abstraction of underlying processor architectures on which the functions are executed, the performance optimization of these functions is challenging. As a result, most FaaS functions use pre compiled libraries generic to x86 64 leading to performance degradation. In this paper, we examine the underlying processor architectures for Google Cloud Functions (GCF) and determine their prevalence across the 19 available GCF regions. We modify, adapt, and optimize three compute intensive FaaS workloads written in Python using Numba, a JIT compiler based on LLVM, and present results wrt performance, memory consumption, and costs on GCF. Results from our experiments show that the optimization of FaaS functions can improve performance by 12.8x (geometric mean) and save costs by 73.4 on average for the three functions. Our results show that optimization of the FaaS functions for the specific architecture is very important. We achieved a maximum speedup of 1.79x by tuning the function especially for the instruction set of the underlying processor architecture.


Bottom Up Human Pose Estimation Via Disentangled Keypoint Regression. In this paper, we are interested in the bottom up paradigm of estimating human poses from an image. We study the dense keypoint regression framework that is previously inferior to the keypoint detection and grouping framework. Our motivation is that regressing keypoint positions accurately needs to learn representations that focus on the keypoint regions. We present a simple yet effective approach, named disentangled keypoint regression (DEKR). We adopt adaptive convolutions through pixel wise spatial transformer to activate the pixels in the keypoint regions and accordingly learn representations from them. We use a multi branch structure for separate regression each branch learns a representation with dedicated adaptive convolutions and regresses one keypoint. The resulting disentangled representations are able to attend to the keypoint regions, respectively, and thus the keypoint regression is spatially more accurate. We empirically show that the proposed direct regression method outperforms keypoint detection and grouping methods and achieves superior bottom up pose estimation results on two benchmark datasets, COCO and CrowdPose. The code and models are available at https github.com HRNet DEKR.


A physiologically realistic virtual patient database for the study of arterial haemodynamics. This study creates a physiologically realistic virtual patient database (VPD), representing the human arterial system, for the primary purpose of studying the affects of arterial disease on haemodynamics. A low dimensional representation of an anatomically detailed arterial network is outlined, and a physiologically realistic posterior distribution for its parameters is constructed through a Bayesian approach. This approach combines both physiological geometrical constraints and the available measurements reported in the literature. A key contribution of this work is to present a framework for including all such available information for the creation of virtual patients (VPs). The Markov Chain Monte Carlo (MCMC) method is used to sample random VPs from this posterior distribution, and the pressure and flow rate profiles associated with the VPs are computed through a model of pulse wave propagation. This combination of the arterial network parameters (representing the VPs) and the haemodynamics waveforms of pressure and flow rates at various locations (representing functional response of the VPs) makes up the VPD. While 75,000 VPs are sampled from the posterior distribution, 10,000 are discarded as the initial burn in period. A further 12,857 VPs are subsequently removed due to the presence of negative average flow rate. Due to an undesirable behaviour observed in some VPs asymmetric under and over damped pressure and flow rate profiles in the left and right sides of the arterial system a filter is proposed for their removal. The final VPD has 28,868 subjects. It is shown that the methodology is appropriate by comparing the VPD statistics to those reported in literature across real populations. A good agreement between the two is found while respecting physiological geometrical constraints. The pre filter database is made available at https doi.org 10.5281 zenodo.4549764.


Straightforward and accurate automatic auxiliary basis set generation for molecular calculations with atomic orbital basis sets. Density fitting (DF), also known as the resolution of the identity (RI), is a widely used technique in quantum chemical calculations with various types of atomic basis sets Gaussian type orbitals, Slater type orbitals, as well as numerical atomic orbitals to speed up density functional, Hartree Fock, and post Hartree Fock calculations. Traditionally, custom auxiliary basis sets are hand optimized for each orbital basis set however, some automatic schemes have also been suggested. In this work, we propose a simple yet numerically stable automated scheme for forming auxiliary basis sets with the help of a pivoted Cholesky decomposition, which is applicable to any type of atomic basis function. We exemplify the scheme with proof of concept calculations with Gaussian basis sets and show that the proposed approach leads to negligible DF RI errors in Hartree Fock (HF) and second order M o ller Plesset (MP2) total energies of the non multireference part of the W4 17 test set when used with orbital basis sets of at least polarized triple zeta quality. The results are promising for future applications employing Slater type orbitals or numerical atomic orbitals, as well as schemes based on the use of local fitting approaches. Global fitting approaches can also be used, in which case the high angular momentum functions produced by the present scheme can be truncated to minimize the computational cost.


Gain dependent Purcell enhancement, breakdown of Einstein's relations and superradiance in nanolasers. Light emitters in a single mode nanolaser interact with the same cavity field, that gives rise to polarization correlations which transform the cavity mode. Usually these correlations are ignored, however, collective phenomena can lead to the distinct sub and superradiance, whose fully quantum description is challenging. Here, we develop a simple yet rigorous picture of radiative transitions in single mode nanolasers that accounts for polarization correlations. We show that the collective behavior of emitters modifies the photonic density of states leading to gain dependent Purcell enhancement of spontaneous emission. Moreover, the stimulated emission rate is dependent on both the photon number and the laser lineshape. As the laser line narrows, stimulated emission becomes stronger than predicted by Einstein's relations and the nanolaser reaches the threshold earlier. Finally, we provide concise, ready to use expressions for spontaneous and stimulated emission rates seamlessly describing both conventional and superradiant nanolasers.


Combination Chemotherapy Optimization with Discrete Dosing. Chemotherapy is one of the primary modalities of cancer treatment. Chemotherapy drug administration is a complex problem that often requires expensive clinical trials to evaluate potential regimens. One way to alleviate this burden and better inform future trials is to build reliable models for drug administration. Previous chemotherapy optimization models have mainly relied on optimal control, which does not lend itself to capturing complex and vital operational constraints in chemotherapy planning involving discrete decisions, such as doses via pills and rest periods. In addition, most of the existing models for chemotherapy optimization lack an explicit toxicity measure and impose toxicity constraints primarily through (fixed) limits on drug concentration. The existing stochastic optimization models also focus on maximizing the probability of cure when tumor heterogeneity is uncertain. In this paper, we develop a mixed integer program for combination chemotherapy (utilization of multiple drugs) optimization that incorporates various important operational constraints and, besides dose and concentration limits, controls treatment toxicity based on its effect on the count of white blood cells. To address the uncertainty of tumor heterogeneity, we propose chance constraints that guarantee reaching an operable tumor size with a high probability in a neoadjuvant setting. We present analytical results pertinent to the accuracy of the model in representing biological processes of chemotherapy and establish its merit for clinical applications through a numerical study of breast cancer.


Rich Semantics Improve Few shot Learning. Human learning benefits from multi modal inputs that often appear as rich semantics (e.g., description of an object's attributes while learning about it). This enables us to learn generalizable concepts from very limited visual examples. However, current few shot learning (FSL) methods use numerical class labels to denote object classes which do not provide rich semantic meanings about the learned concepts. In this work, we show that by using 'class level' language descriptions, that can be acquired with minimal annotation cost, we can improve the FSL performance. Given a support set and queries, our main idea is to create a bottleneck visual feature (hybrid prototype) which is then used to generate language descriptions of the classes as an auxiliary task during training. We develop a Transformer based forward and backward encoding mechanism to relate visual and semantic tokens that can encode intricate relationships between the two modalities. Forcing the prototypes to retain semantic information about class description acts as a regularizer on the visual features, improving their generalization to novel classes at inference. Furthermore, this strategy imposes a human prior on the learned representations, ensuring that the model is faithfully relating visual and semantic concepts, thereby improving model interpretability. Our experiments on four datasets and ablation studies show the benefit of effectively modeling rich semantics for FSL.


The generalized Hopf invariant and four fold Toda brackets. We give two formulas for the generalized Hopf invariant and 4 fold Toda brackets which are useful in computations of homotopy groups of spheres.


Computational Enumeration of Andr 'e Planes. In this paper, we address computational questions surrounding the enumeration of non isomorphic Andr 'e planes for any prime power order. We are particularly focused on providing a complete enumeration of all such planes for relatively small orders (up to 125), as well as developing computationally efficient ways to count the number of isomorphism classes for other orders where enumeration is infeasible. Andr 'e planes of all dimensions over their kernel are considered.


On the topology of some hyperspaces of convex bodies associated to tensor norms. For every tuple d 1, dots, d l geq 2, let mathbb R d 1 otimes cdots otimes mathbb R d l denote the tensor product of mathbb R d i , i 1, dots,l. Let us denote by mathcal B (d) the hyperspace of centrally symmetric convex bodies in mathbb R d, d d 1 cdots d l, endowed with the Hausdorff distance, and by mathcal B otimes(d 1, dots,d l) the subset of mathcal B (d) consisting of the convex bodies that are closed unit balls of reasonable crossnorms on mathbb R d 1 otimes cdots otimes mathbb R d l . It is known that mathcal B otimes(d 1, dots,d l) is a closed, contractible and locally compact subset of mathcal B (d). The hyperspace mathcal B otimes(d 1, dots,d l) is called the space of tensorial bodies. In this work we determine the homeomorphism type of mathcal B otimes(d 1, dots,d l). We show that even if mathcal B otimes(d 1, dots,d l) is not closed with respect to the Minkowski sum, it is an absolute retract homeomorphic to mathcal Q times mathbb R p, where mathcal Q is the Hilbert cube and p frac d 1(d 1 1) cdots d l(d l 1) 2 . Among other results, the relation between the Banach Mazur compactum and the Banach Mazur type compactum associated to mathcal B otimes(d 1, dots,d l) is examined.


Can Character based Language Models Improve Downstream Task Performance in Low Resource and Noisy Language Scenarios?. Recent impressive improvements in NLP, largely based on the success of contextual neural language models, have been mostly demonstrated on at most a couple dozen high resource languages. Building language models and, more generally, NLP systems for non standardized and low resource languages remains a challenging task. In this work, we focus on North African colloquial dialectal Arabic written using an extension of the Latin script, called NArabizi, found mostly on social media and messaging communication. In this low resource scenario with data displaying a high level of variability, we compare the downstream performance of a character based language model on part of speech tagging and dependency parsing to that of monolingual and multilingual models. We show that a character based model trained on only 99k sentences of NArabizi and fined tuned on a small treebank of this language leads to performance close to those obtained with the same architecture pre trained on large multilingual and monolingual models. Confirming these results a on much larger data set of noisy French user generated content, we argue that such character based language models can be an asset for NLP in low resource and high language variability set tings.


Multi objective Conflict based Search Using Safe interval Path Planning. This paper addresses a generalization of the well known multi agent path finding (MAPF) problem that optimizes multiple conflicting objectives simultaneously such as travel time and path risk. This generalization, referred to as multi objective MAPF (MOMAPF), arises in several applications ranging from hazardous material transportation to construction site planning. In this paper, we present a new multi objective conflict based search (MO CBS) approach that relies on a novel multi objective safe interval path planning (MO SIPP) algorithm for its low level search. We first develop the MO SIPP algorithm, show its properties and then embed it in MO CBS. We present extensive numerical results to show that (1) there is an order of magnitude improvement in the average low level search time, and (2) a significant improvement in the success rates of finding the Pareto optimal front can be obtained using the proposed approach in comparison with the previous MO CBS.


Semantic Segmentation assisted Scene Completion for LiDAR Point Clouds. Outdoor scene completion is a challenging issue in 3D scene understanding, which plays an important role in intelligent robotics and autonomous driving. Due to the sparsity of LiDAR acquisition, it is far more complex for 3D scene completion and semantic segmentation. Since semantic features can provide constraints and semantic priors for completion tasks, the relationship between them is worth exploring. Therefore, we propose an end to end semantic segmentation assisted scene completion network, including a 2D completion branch and a 3D semantic segmentation branch. Specifically, the network takes a raw point cloud as input, and merges the features from the segmentation branch into the completion branch hierarchically to provide semantic information. By adopting BEV representation and 3D sparse convolution, we can benefit from the lower operand while maintaining effective expression. Besides, the decoder of the segmentation branch is used as an auxiliary, which can be discarded in the inference stage to save computational consumption. Extensive experiments demonstrate that our method achieves competitive performance on SemanticKITTI dataset with low latency. Code and models will be released at https github.com jokester zzz SSA SC.


Class Discriminative CNN Compression. Compressing convolutional neural networks (CNNs) by pruning and distillation has received ever increasing focus in the community. In particular, designing a class discrimination based approach would be desired as it fits seamlessly with the CNNs training objective. In this paper, we propose class discriminative compression (CDC), which injects class discrimination in both pruning and distillation to facilitate the CNNs training goal. We first study the effectiveness of a group of discriminant functions for channel pruning, where we include well known single variate binary class statistics like Student's T Test in our study via an intuitive generalization. We then propose a novel layer adaptive hierarchical pruning approach, where we use a coarse class discrimination scheme for early layers and a fine one for later layers. This method naturally accords with the fact that CNNs process coarse semantics in the early layers and extract fine concepts at the later. Moreover, we leverage discriminant component analysis (DCA) to distill knowledge of intermediate representations in a subspace with rich discriminative information, which enhances hidden layers' linear separability and classification accuracy of the student. Combining pruning and distillation, CDC is evaluated on CIFAR and ILSVRC 2012, where we consistently outperform the state of the art results.


Correlated vibration solvent effects on the non Condon exciton spectroscopy. Excitation energy transfer is crucially involved in a variety of systems. During the process, the non Condon vibronic coupling and the surrounding solvent interaction may synergetically play important roles. In this work, we study the correlated vibration solvent influences on the non Condon exciton spectroscopy. Statistical analysis is elaborated for the overall vibration plus solvent environmental effects. Analytic solutions are derived for the linear absorption of monomer systems. General simulations are accurately carried out via the dissipaton equation of motion approach. The resulted spectra in either the linear absorption or strong field regime clearly demonstrate the coherence enhancement due to the synergetic vibration solvent correlation.


The infimum of the dual volume of convex co compact hyperbolic 3 manifolds. We show that the infimum of the dual volume of the convex core of a convex co compact hyperbolic 3 manifold with incompressible boundary coincides with the infimum of the Riemannian volume of its convex core, as we vary the geometry by quasi isometric deformations. We deduce a linear lower bound of the volume of the convex core of a quasi Fuchsian manifold in terms of the length of its bending measured lamination, with optimal multiplicative constant.


Predicting Loss Risks for B2B Tendering Processes. Sellers and executives who maintain a bidding pipeline of sales engagements with multiple clients for many opportunities significantly benefit from data driven insight into the health of each of their bids. There are many predictive models that offer likelihood insights and win prediction modeling for these opportunities. Currently, these win prediction models are in the form of binary classification and only make a prediction for the likelihood of a win or loss. The binary formulation is unable to offer any insight as to why a particular deal might be predicted as a loss. This paper offers a multi class classification model to predict win probability, with the three loss classes offering specific reasons as to why a loss is predicted, including no bid, customer did not pursue, and lost to competition. These classes offer an indicator of how that opportunity might be handled given the nature of the prediction. Besides offering baseline results on the multi class classification, this paper also offers results on the model after class imbalance handling, with the results achieving a high accuracy of 85 and an average AUC score of 0.94.


Hierarchical Attention Fusion for Geo Localization. Geo localization is a critical task in computer vision. In this work, we cast the geo localization as a 2D image retrieval task. Current state of the art methods for 2D geo localization are not robust to locate a scene with drastic scale variations because they only exploit features from one semantic level for image representations. To address this limitation, we introduce a hierarchical attention fusion network using multi scale features for geo localization. We extract the hierarchical feature maps from a convolutional neural network (CNN) and organically fuse the extracted features for image representations. Our training is self supervised using adaptive weights to control the attention of feature emphasis from each hierarchical level. Evaluation results on the image retrieval and the large scale geo localization benchmarks indicate that our method outperforms the existing state of the art methods. Code is available here url https github.com YanLiqi HAF .


Electromagnetic force and torque derived from a Lagrangian in conjunction with the Maxwell Lorentz equations. Electromagnetic force and torque are typically derived from a stress tensor in conjunction with Maxwell's equations of classical electrodynamics. In some instances, the Principle of Least Action (built around a Lagrangian) can be used to arrive at the same mathematical expressions of force and torque as those derived from a stress tensor. This paper describes some of the underlying arguments for the existence of a Lagrangian in the case of certain simple physical systems. While some formulations of electromagnetic force and torque admit a Lagrangian, there are other formulations for which a Lagrangian may not exist.


Through the Looking Glass Insights into Visualization Pedagogy through Sentiment Analysis of Peer Review Text. Peer review is a widely utilized feedback mechanism for engaging students. As a pedagogical method, it has been shown to improve educational outcomes, but we have found limited empirical measurement of peer review in visualization courses. In addition to increasing engagement, peer review provides diverse feedback and reinforces recently learned course concepts through critical evaluation of others' work. We discuss the construction and application of peer review in two visualization courses from different colleges at the University of South Florida. We then analyze student projects and peer review text via sentiment analysis to infer insights for visualization educators, including the focus of course content, engagement across student groups, student mastery of concepts, course trends over time, and expert intervention effectiveness. Finally, we provide suggestions for adapting peer review to other visualization courses to engage students and increase instructor understanding of the peer review process.


Dynamic Texture Recognition using PDV Hashing and Dictionary Learning on Multi scale Volume Local Binary Pattern. Spatial temporal local binary pattern (STLBP) has been widely used in dynamic texture recognition. STLBP often encounters the high dimension problem as its dimension increases exponentially, so that STLBP could only utilize a small neighborhood. To tackle this problem, we propose a method for dynamic texture recognition using PDV hashing and dictionary learning on multi scale volume local binary pattern (PHD MVLBP). Instead of forming very high dimensional LBP histogram features, it first uses hash functions to map the pixel difference vectors (PDVs) to binary vectors, then forms a dictionary using the derived binary vector, and encodes them using the derived dictionary. In such a way, the PDVs are mapped to feature vectors of the size of dictionary, instead of LBP histograms of very high dimension. Such an encoding scheme could extract the discriminant information from videos in a much larger neighborhood effectively. The experimental results on two widely used dynamic textures datasets, DynTex and UCLA, show the superiority performance of the proposed approach over the state of the art methods.


Simulation of large area metasurfaces with a distributed transition matrix method. Inverse design of large area metasurfaces can potentially exploit the full parameter space that such devices offer and achieve highly efficient multifunctional flat optical elements. However, since practically useful flat optics elements are large in the linear dimension, an accurate simulation of their scattering properties is challenging. Here, we demonstrate a method to compute accurate simulations and gradients of large area metasurfaces. Our approach relies on two key ingredients a simulation distribution strategy that allows a linear reduction in the simulation time with number of compute (GPU) nodes and an efficient single node computation using the Transition matrix (T matrix) method. We demonstrate ability to perform a distributed simulation of large area, while accurately accounting for scatterer scatterer interactions significantly beyond the locally periodic approximation, and efficiently compute gradients with respect to the metasurface design parameters. This scalable and accurate metasurface simulation method opens the door to gradient based optimization of full large area metasurfaces.


Mathematical modelling and virtual decomposition control of heavy duty parallel serial hydraulic manipulators. This paper proposes a novel modelling approach for a heavy duty manipulator with parallel serial structures connected in series. Each considered parallel serial structure contains a revolute segment with rigid links connected by a passive revolute joint and actuated by a linear hydraulic actuator, thus forming a closed kinematic loop. In addition, prismatic segments, consisting of prismatic joints driven by hydraulic linear actuators, also are considered. Expressions for actuator forces are derived using the Newton Euler (N E) dynamics formulation. The derivation process does not assume massless actuators decoupled from manipulator links, which is common in the Lagrange dynamics formulation. Actuator pressure dynamics are included in the analysis, leading in total to a third order system of ordinary differential equations (ODEs). The proposed model in the N E framework, with fewer parameters than its predecessors, inspires revision of the virtual decomposition control (VDC) systematic process to formulate a control law based on the new model. The virtual stability of each generic manipulator revolute and prismatic segment is obtained, leading to the Lyapunov stability of the entire robot.


Softplus Penalty Functions for Constrained Optimization. Penalty functions are widely used to enforce constraints in optimization problems and reinforcement leaning algorithms. Softplus and algebraic penalty functions are proposed to overcome the sensitivity of the Courant Beltrami method to strong objective function gradients. These penalty functions are shown to converge in one fifth as many iterations on problems with fifty optimized parameters and be less sensitive to objective function gradient and scaling than the Courant Beltrami penalty function. The softplus and algebraic penalty functions developed in this work allow optimized solutions to be found in fewer iterations with greater control over constraint accuracy.


A rate of convergence of Physics Informed Neural Networks for the linear second order elliptic PDEs. In recent years, physical informed neural networks (PINNs) have been shown to be a powerful tool for solving PDEs empirically. However, numerical analysis of PINNs is still missing. In this paper, we prove the convergence rate to PINNs for the second order elliptic equations with Dirichlet boundary condition, by establishing the upper bounds on the number of training samples, depth and width of the deep neural networks to achieve desired accuracy. The error of PINNs is decomposed into approximation error and statistical error, where the approximation error is given in C 2 norm with mathrm ReLU 3 networks (deep network with activations function max 0,x 3 ) and the statistical error is estimated by Rademacher complexity. We derive the bound on the Rademacher complexity of the non Lipschitz composition of gradient norm with mathrm ReLU 3 network, which is of immense independent interest.


Computing Groebner bases of ideal interpolation. We present algorithms for computing the reduced Gr " o bner basis of the vanishing ideal of a finite set of points in a frame of ideal interpolation. Ideal interpolation is defined by a linear projector whose kernel is a polynomial ideal. In this paper, we translate interpolation condition functionals into formal power series via Taylor expansion, then the reduced Gr " o bner basis is read from formal power series by Gaussian elimination. Our algorithm has a polynomial time complexity. It compares favorably with MMM algorithm in single point ideal interpolation and some several points ideal interpolation.


Homological mirror symmetry at large volume. A typical large complex structure limit for mirror symmetry consists of toric varieties glued to each other along their toric boundaries. Here we construct the mirror large volume limit space as a Weinstein symplectic manifold. We prove homological mirror symmetry the category of coherent sheaves on the first space is equivalent to the Fukaya category of the second. Our equivalence intertwines the Viterbo restriction maps for a generalized pair of pants cover of the symplectic manifold with the restriction of coherent sheaves for a certain affine cover of the algebraic variety. We deduce a posteriori a local to global principle conjectured by Seidel certain diagrams of Viterbo restrictions are cartesian by passing Zariski descent through our mirror symmetry result.


360 deg polarization control of terahertz spintronic emitters using uniaxial FeCo TbCo2 FeCo trilayers. Polarization control of THz light is of paramount interest for the numerous applications offered in this frequency range. Recent developments in THz spintronic emitters allow for a very efficient broadband emission, and especially unique is their ability of THz polarization switching through magnetization control of the ferromagnetic layer. Here we present an improved scheme to achieve full 360 deg nearly coherent polarization rotation that does not require multipolar or rotating external magnetic bias nor complex cascaded emitters. By replacing the FM layer of the spintronic emitter with a carefully designed FeCo TbCo2 FeCo anisotropic heterostructure, we experimentally demonstrate Stoner Wohlfarth like coherent rotation of the THz polarization over a full 2pi azimuth only by a bipolar variation of the strength of the hard axis field, and with only a negligible decrease in the emission efficiency as compared to standard Pt CoFeB W inverse spin Hall emitters. THz measurements are in agreement with our model of the non perfect Stoner Wohlfarth behaviour. These emitters are well adapted for the implementation of polarimetric characterization not requiring any mechanically rotating polarizing elements. An example is given with the characterization of the birefringence in a quartz plate.


Nakayama algebras and Fuchsian singularities. This present paper is devoted to the study of a class of Nakayama algebras N n(r) given by the path algebra of the equioriented quiver mathbb A n subject to the nilpotency degree r for each sequence of r consecutive arrows. We show that the Nakayama algebras N n(r) for certain pairs (n,r) can be realized as endomorphism algebras of tilting objects in the bounded derived category of coherent sheaves over a weighted projective line, or in its stable category of vector bundles. Moreover, we classify all the Nakayama algebras N n(r) of Fuchsian type, that is, derived equivalent to the bounded derived categories of extended canonical algebras. We also provide a new way to prove the classification result on Nakayama algebras of piecewise hereditary type, which have been done by Happel Seidel before.


Lattice isomorphisms of Leibniz algebras. Leibniz algebras are a non anticommutative version of Lie algebras. They play an important role in different areas of mathematics and physics and have attracted much attention over the last thirty years. In this paper we investigate whether conditions such as being a Lie algebra, cyclic, simple, semisimple, solvable, supersolvable or nilpotent in such an algebra are preserved by lattice isomorphisms.


On subadditivity of Okounkov bodies for algebraic fiber spaces. The purpose of this paper is to establish a subadditivity theorem of Okounkov bodies for algebraic fiber spaces. As applications, we obtain a product formula of the restricted canonical volumes for algebraic fiber spaces and a sufficient condition for an algebraic fiber space to be birationally isotrivial in terms of Okounkov bodies when a general fiber is of general type. Furthermore, we also prove the subadditivity of the numerical Iitaka dimensions for algebraic fiber spaces, and this confirms some numerical variants of the Iitaka conjecture. We hope that our results would provide a new approach toward the Iitaka conjecture.


Aligning Robot's Behaviours and Users' Perceptions Through Participatory Prototyping. Robots are increasingly being deployed in public spaces. However, the general population rarely has the opportunity to nominate what they would prefer or expect a robot to do in these contexts. Since most people have little or no experience interacting with a robot, it is not surprising that robots deployed in the real world may fail to gain acceptance or engage their intended users. To address this issue, we examine users' understanding of robots in public spaces and their expectations of appropriate uses of robots in these spaces. Furthermore, we investigate how these perceptions and expectations change as users engage and interact with a robot. To support this goal, we conducted a participatory design workshop in which participants were actively involved in the prototyping and testing of a robot's behaviours in simulation and on the physical robot. Our work highlights how social and interaction contexts influence users' perception of robots in public spaces and how users' design and understanding of what are appropriate robot behaviors shifts as they observe the enactment of their designs.


GOO A Dataset for Gaze Object Prediction in Retail Environments. One of the most fundamental and information laden actions humans do is to look at objects. However, a survey of current works reveals that existing gaze related datasets annotate only the pixel being looked at, and not the boundaries of a specific object of interest. This lack of object annotation presents an opportunity for further advancing gaze estimation research. To this end, we present a challenging new task called gaze object prediction, where the goal is to predict a bounding box for a person's gazed at object. To train and evaluate gaze networks on this task, we present the Gaze On Objects (GOO) dataset. GOO is composed of a large set of synthetic images (GOO Synth) supplemented by a smaller subset of real images (GOO Real) of people looking at objects in a retail environment. Our work establishes extensive baselines on GOO by re implementing and evaluating selected state of the art models on the task of gaze following and domain adaptation. Code is available on github.


GermanQuAD and GermanDPR Improving Non English Question Answering and Passage Retrieval. A major challenge of research on non English machine reading for question answering (QA) is the lack of annotated datasets. In this paper, we present GermanQuAD, a dataset of 13,722 extractive question answer pairs. To improve the reproducibility of the dataset creation approach and foster QA research on other languages, we summarize lessons learned and evaluate reformulation of question answer pairs as a way to speed up the annotation process. An extractive QA model trained on GermanQuAD significantly outperforms multilingual models and also shows that machine translated training data cannot fully substitute hand annotated training data in the target language. Finally, we demonstrate the wide range of applications of GermanQuAD by adapting it to GermanDPR, a training dataset for dense passage retrieval (DPR), and train and evaluate the first non English DPR model.


A horizontal Chern Gauss Bonnet formula on totally geodesic foliations. Under suitable conditions, we show that the Euler characteristic of a foliated Riemannian manifold can be computed only from curvature invariants which are transverse to the leaves. Our proof uses the hypoelliptic sub Laplacian on forms recently introduced by two of the authors.


imath quantum groups of split type via derived Hall algebras. A quantum symmetric pair consists of a quantum group mathbf U and its coideal subalgebra mathbf U imath boldsymbol varsigma (called an imath quantum group) with parameters boldsymbol varsigma . In this note, we use the derived Hall algebras of 1 periodic complexes to realize the imath quantum groups mathbf U imath boldsymbol varsigma of split type.


Improving Security in McAdams Coefficient Based Speaker Anonymization by Watermarking Method. Speaker anonymization aims to suppress speaker individuality to protect privacy in speech while preserving the other aspects, such as speech content. One effective solution for anonymization is to modify the McAdams coefficient. In this work, we propose a method to improve the security for speaker anonymization based on the McAdams coefficient by using a speech watermarking approach. The proposed method consists of two main processes one for embedding and one for detection. In embedding process, two different McAdams coefficients represent binary bits 0" and 1". The watermarked speech is then obtained by frame by frame bit inverse switching. Subsequently, the detection process is carried out by a power spectrum comparison. We conducted objective evaluations with reference to the VoicePrivacy 2020 Challenge (VP2020) and of the speech watermarking with reference to the Information Hiding Challenge (IHC) and found that our method could satisfy the blind detection, inaudibility, and robustness requirements in watermarking. It also significantly improved the anonymization performance in comparison to the secondary baseline system in VP2020.


Arbitrary Wave Transformations with Huygens' Metasurfaces through Surface Wave Optimization. Huygens' metasurfaces have demonstrated the ability to tailor electromagnetic wavefronts with passive low profile structures. The fundamental constraint enabling passive and ideally lossless solutions is the conservation of the normal real power locally along the metasurface. In this work, we examine the use of auxiliary surface waves to overcome this limitation and design Huygens' metasurfaces for wave transformations with different incident and output power density profiles. The developed method relies on the optimization of a surface wave distribution that is utilized to redistribute the power at the input side of the metasurface without incurring any reflections. A full design example is presented with a linear patch array along the H plane illuminating a metasurface that produces uniform output fields along the E plane. A high aperture illumination efficiency of 92 is obtained despite the small distance between the source and the metasurface. Moreover, the effects of the evanescent spectrum to the losses and the bandwidth of the structure are discussed.


Global well posedness and exponential decay to the Cauchy problem of nonhomogeneous Navier Stokes equations with density dependent viscosity and vacuum in mathbb R 2 . We study global well posedness of strong solutions for the nonhomogeneous Navier Stokes equations with density dependent viscosity and initial density allowing vanish in mathbb R 2 . Applying a logarithmic interpolation inequality and delicate energy estimates, we show the global existence of a unique strong solution provided that nabla mu( rho 0) L q is suitably small, which improves the previous result of Huang and Wang SIAM J. Math. Anal. 46, 1771 1788 (2014) to the whole space case. Moreover, we also derive exponential decay rates of the solution. In particular, there is no need to require additional initial compatibility condition despite the presence of vacuum.


Physical Fault Injection and Side Channel Attacks on Mobile Devices A Comprehensive Analysis. Today's mobile devices contain densely packaged system on chips (SoCs) with multi core, high frequency CPUs and complex pipelines. In parallel, sophisticated SoC assisted security mechanisms have become commonplace for protecting device data, such as trusted execution environments, full disk and file based encryption. Both advancements have dramatically complicated the use of conventional physical attacks, requiring the development of specialised attacks. In this survey, we consolidate recent developments in physical fault injections and side channel attacks on modern mobile devices. In total, we comprehensively survey over 50 fault injection and side channel attack papers published between 2009 2021. We evaluate the prevailing methods, compare existing attacks using a common set of criteria, identify several challenges and shortcomings, and suggest future directions of research.


Explicit commutative sequence space representations of function and distribution spaces on the real half line. We provide explicit commutative sequence space representations for classical function and distribution spaces on the real half line. This is done by evaluating at the Fourier transforms of the elements of an orthonormal wavelet basis.


Free boundary regularity in the multiple membrane problem in the plane. We study the regularity of free boundaries in the multiple elastic membrane problem in the plane. We prove the uniqueness of blow ups, and that the free boundaries are C 1, log curves near a regular intersection point.


Relativized depth. Bennett's notion of depth is usually considered to describe the usefulness and internal organization of the information encoded into an object such as an infinite binary sequence. We consider a natural way to relativize the notion of depth for such sets, and we investigate for various kinds of oracles whether and how the unrelativized and the relativized version of depth differ. Intuitively speaking, access to an oracle increases computation power. Accordingly, for most notions for sets considered in computability theory, for the corresponding classes trivially for all oracles the unrelativized class is contained in the relativized class or for all oracles the relativized class is contained in the unrelativized class. Examples for these two cases are given by the classes of computable and of Martin L " o f random sets, respectively. However, in the case for depth the situation is different. It turns out that the classes of deep sets and of sets that are deep relative to the halting set emptyset ' are incomparable with respect to set theoretical inclusion. On the other hand, the class of deep sets is strictly contained in the class of sets that are deep relative to any given Martin L " o f random oracle. The set built in the proof of the latter result can also be used to give a short proof of the known fact that every PA complete degree is Turing equivalent to the join of two Martin L " o f random sets. In fact, we slightly strengthen this result by showing that every DNC 2 function is truth table equivalent to the join of two Martin L " o f random sets. Furthermore, we observe that the class of deep sets relative to any given K trivial oracle either is the same as or is strictly contained in the class of deep sets. Obviously, the former case applies to computable oracles. We leave it as an open problem which of the two possibilities can occur for noncomputable K trivial oracles.


Defeating Super Reactive Jammers With Deception Strategy Modeling, Signal Detection, and Performance Analysis. This paper develops a novel framework to defeat a super reactive jammer, one of the most difficult jamming attacks to deal with in practice. Specifically, the jammer has an unlimited power budget and is equipped with the self interference suppression capability to simultaneously attack and listen to the transmitter's activities. Consequently, dealing with super reactive jammers is very challenging. Thus, we introduce a smart deception mechanism to attract the jammer to continuously attack the channel and then leverage jamming signals to transmit data based on the ambient backscatter communication technology. To detect the backscattered signals, the maximum likelihood detector can be adopted. However, this method is notorious for its high computational complexity and requires the model of the current propagation environment as well as channel state information. Hence, we propose a deep learning based detector that can dynamically adapt to any channels and noise distributions. With a Long Short Term Memory network, our detector can learn the received signals' dependencies to achieve a performance close to that of the optimal maximum likelihood detector. Through simulation and theoretical results, we demonstrate that with our approaches, the more power the jammer uses to attack the channel, the better bit error rate performance the transmitter can achieve.


To mock a Mocking bird Studies in Biomimicry. This paper dwells on certain novel game theoretic investigations in bio mimicry, discussed from the perspectives of information asymmetry, individual utility and its optimization via strategic interactions involving co evolving preys (e.g., insects) and predators (e.g., reptiles) who learn. Formally, we consider a panmictic ecosystem, occupied by species of prey with relatively short lifespan, which evolve mimicry signals over generations as they interact with predators with relatively longer lifespans, thus endowing predators with the ability to learn prey signals. Every prey sends a signal and provides utility to the predator. The prey can be either nutritious or toxic to the predator, but the prey may signal (possibly) deceptively without revealing its true "type." The model is used to study the situation where multi armed bandit predators with zero prior information are introduced into the ecosystem. As a result of exploration and exploitation the predators naturally select the prey that result in the evolution of those signals. This co evolution of strategies produces a variety of interesting phenomena which are subjects of this paper.


Affinoid Dixmier modules and the deformed Dixmier Moeglin equivalence. The affinoid envelope, widehat U( mathcal L ) of a free, finitely generated mathbb Z p Lie algebra mathcal L has proven to be useful within the representation theory of compact p adic Lie groups. Our aim is to further understand the algebraic structure of widehat U( mathcal L ) , and to this end, we will define a Dixmier module over widehat U( mathcal L ) , and prove that this object is generally irreducible in case where mathcal L is nilpotent. Ultimately, we will prove that all primitive ideals in the affinoid envelope can be described in terms of the annihilators of Dixmier modules, and using this, we aim towards proving that these algebras satisfy a version of the classical Dixmier Moeglin equivalence.


Maps preserving two sided zero products on Banach algebras. Let A and B be Banach algebras with bounded approximate identities and let Phi A to B be a surjective continuous linear map which preserves two sided zero products (i.e., Phi(a) Phi(b) Phi(b) Phi(a) 0 whenever ab ba 0 ). We show that Phi is a weighted Jordan homomorphism provided that A is zero product determined and weakly amenable. These conditions are in particular fulfilled when A is the group algebra L 1(G) with G any locally compact group. We also study a more general type of continuous linear maps Phi A to B that satisfy Phi(a) Phi(b) Phi(b) Phi(a) 0 whenever ab ba 0 . We show in particular that if Phi is surjective and A is a C algebra, then Phi is a weighted Jordan homomorphism.


Internal Absolute Geometry. We model systems as objects in a certain ambient Grothendieck site with additional structure. We introduce generalized sheaves, called virtual manifolds. These sheaves reconstruct an internal groupoid which models instances of the holonomy groupoid of foliations, but in the broader framework of integrable, almost regular systems. A generalization of the Morita invariant homotopy type to the setting of internal groupoids, furnishes a generalized version of the Lusternik Schnirelmann invariant for groupoids. This invariant, referred to herein as geometric complexity, computes the number of transitive components of the generalized holonomy groupoid, up to Morita invariant homotopy. We introduce a so called internal absolute geometry, as a bicategory localization at the Morita homotopies and internal point groupoids, i.e. at the absolute point. We extend the geometric complexity to a well defined bifunctor on this bicategory localization.


Global Yamabe flow on asymptotically flat manifolds. In this paper, we study the existence of global Yamabe flow on asymptotically flat (in short, AF or ALE) manifolds. Note that the ADM mass is preserved in dimensions 3,4 and 5. We present a new general local existence of Yamabe flow on a complete Riemannian manifold with the initial metric quasi isometric to a background metric of bounded scalar curvature. Asymptotic behaviour of the Yamabe flow on ALE manifolds is also addressed provided the initial scalar curvature is non negative and there is a bounded subsolution to the corresponding Poisson equation. We also present a maximum principle for a very general parabolic equations on the complete Riemannian manifolds.


Cryptanalysis of Semidirect Product Key Exchange Using Matrices Over Non Commutative Rings. It was recently demonstrated that the Matrix Action Key Exchange (MAKE) algorithm, a new type of key exchange protocol using the semidirect product of matrix groups, is vulnerable to a linear algebraic attack if the matrices are over a commutative ring. In this note, we establish conditions under which protocols using matrices over a non commutative ring are also vulnerable to this attack. We then demonstrate that group rings R G are examples of non commutative rings that satisfy these conditions.


Foveal pit inspired filtering of DVS spike response. In this paper, we present results of processing Dynamic Vision Sensor (DVS) recordings of visual patterns with a retinal model based on foveal pit inspired Difference of Gaussian (DoG) filters. A DVS sensor was stimulated with varying number of vertical white and black bars of different spatial frequencies moving horizontally at a constant velocity. The output spikes generated by the DVS sensor were applied as input to a set of DoG filters inspired by the receptive field structure of the primate visual pathway. In particular, these filters mimic the receptive fields of the midget and parasol ganglion cells (spiking neurons of the retina) that sub serve the photo receptors of the foveal pit. The features extracted with the foveal pit model are used for further classification using a spiking convolutional neural network trained with a backpropagation variant adapted for spiking neural networks.


ManiFest Manifold Deformation for Few shot Image Translation. Most image to image translation methods require a large number of training images, which restricts their applicability. We instead propose ManiFest a framework for few shot image translation that learns a context aware representation of a target domain from a few images only. To enforce feature consistency, our framework learns a style manifold between source and proxy anchor domains (assumed to be composed of large numbers of images). The learned manifold is interpolated and deformed towards the few shot target domain via patch based adversarial and feature statistics alignment losses. All of these components are trained simultaneously during a single end to end loop. In addition to the general few shot translation task, our approach can alternatively be conditioned on a single exemplar image to reproduce its specific style. Extensive experiments demonstrate the efficacy of ManiFest on multiple tasks, outperforming the state of the art on all metrics and in both the general and exemplar based scenarios. Our code is available at https github.com cv rits Manifest .


A simple upper bound for Lebesgue constants associated with Leja points on the real line. Let K subset mathbb R be a regular compact set and let g(z) g overline mathbb C setminus K (z, infty) be the Green function for overline mathbb C setminus K with pole at infinity. For delta 0 , define G( delta) max g(z) z in mathbb C, , operatorname dist (z,K) le 2 delta . Let x n n 0 infty be a Leja sequence of points of K . Then the uniform norm T n Lambda n, n 1,2, ldots of the associated interpolation operator T n , i.e., the n th Lebesgue constant, is bounded from above by min delta 0 2n left frac operatorname diam ( K) delta e nG( delta) right 9 8 . In particular, when K is a uniformly perfect subset of mathbb R , the Lebesgue constants grow at most polynomially in n . To the best of our knowledge, the result is new even when K is a finite union of intervals.


Representation stability and outer automorphism groups. In this paper we study families of representations of the outer automorphism groups indexed on a collection of finite groups mathcal U . We encode this large amount of data into a convenient abelian category mathcal A mathcal U which generalizes the category of VI modules appearing in the representation theory of the finite general linear groups. Inspired by work of Church Ellenberg Farb, we investigate for which choices of mathcal U the abelian category is locally noetherian and deduce analogues of central stability and representation stability results in this setting. Finally, we show that some invariants coming from rational global homotopy theory exhibit representation stability.


A Simple Approach for Non stationary Linear Bandits. This paper investigates the problem of non stationary linear bandits, where the unknown regression parameter is evolving over time. Existing studies develop various algorithms and show that they enjoy an widetilde mathcal O (T 2 3 P T 1 3 ) dynamic regret, where T is the time horizon and P T is the path length that measures the fluctuation of the evolving unknown parameter. In this paper, we discover that a serious technical flaw makes their results ungrounded, and then present a fix, which gives an widetilde mathcal O (T 3 4 P T 1 4 ) dynamic regret without modifying original algorithms. Furthermore, we demonstrate that instead of using sophisticated mechanisms, such as sliding window or weighted penalty, a simple restarted strategy is sufficient to attain the same regret guarantee. Specifically, we design an UCB type algorithm to balance exploitation and exploration, and restart it periodically to handle the drift of unknown parameters. Our approach enjoys an widetilde mathcal O (T 3 4 P T 1 4 ) dynamic regret. Note that to achieve this bound, the algorithm requires an oracle knowledge of the path length P T . Combining the bandits over bandits mechanism by treating our algorithm as the base learner, we can further achieve the same regret bound in a parameter free way. Empirical studies also validate the effectiveness of our approach.


Kashiwara's theorem for twisted arithmetic differential operators. We establish a version of Kashiwara's theorem for twisted sheaves of Berthelot's arithmetic differential operators for a closed immersion between smooth p adic formal schemes. As an application, we construct simple modules for crystalline distribution algebras of reductive groups using the twisted version of the crystalline localisation theorem.


Trigonometric approximation of the Max Cut Polytope is star like. The Max Cut polytope appears in the formulation of many difficult combinatorial optimization problems. These problems can also be formulated as optimization problems over the so called trigonometric approximation which possesses an algorithmically accessible description but is not convex. Hirschfeld conjectured that this trigonometric approximation is star like. In this article, we provide a proof of this conjecture.


Multiscale genesis of a tiny giant for percolation on scale free random graphs. We study the critical behavior for percolation on inhomogeneous random networks on n vertices, where the weights of the vertices follow a power law distribution with exponent tau in (2,3) . Such networks, often referred to as scale free networks, exhibit critical behavior when the percolation probability tends to zero at an appropriate rate, as n to infty . We identify the critical window for a host of scale free random graph models such as the Norros Reittu model, Chung Lu model and generalized random graphs. Surprisingly, there exists a finite time inside the critical window, after which, we see a sudden emergence of a tiny giant component. This is a novel behavior which is in contrast with the critical behavior in other known universality classes with tau in (3,4) and tau 4 . Precisely, for edge retention probabilities pi n lambda n (3 tau) 2 , there is an explicitly computable lambda c 0 such that the critical window is of the form lambda in (0, lambda c), where the largest clusters have size of order n beta with beta ( tau 2 4 tau 5) 2( tau 1) in sqrt 2 1, tfrac 1 2 ) and have non degenerate scaling limits, while in the supercritical regime lambda lambda c , a unique tiny giant' component of size sqrt n emerges. For lambda in (0, lambda c), the scaling limit of the maximum component sizes can be described in terms of components of a one dimensional inhomogeneous percolation model on mathbb Z studied in a seminal work by Durrett and Kesten. For lambda lambda c , we prove that the sudden emergence of the tiny giant is caused by a phase transition inside a smaller core of vertices of weight Omega( sqrt n ) .


Joint Learning On The Hierarchy Representation for Fine Grained Human Action Recognition. Fine grained human action recognition is a core research topic in computer vision. Inspired by the recently proposed hierarchy representation of fine grained actions in FineGym and SlowFast network for action recognition, we propose a novel multi task network which exploits the FineGym hierarchy representation to achieve effective joint learning and prediction for fine grained human action recognition. The multi task network consists of three pathways of SlowOnly networks with gradually increased frame rates for events, sets and elements of fine grained actions, followed by our proposed integration layers for joint learning and prediction. It is a two stage approach, where it first learns deep feature representation at each hierarchical level, and is followed by feature encoding and fusion for multi task learning. Our empirical results on the FineGym dataset achieve a new state of the art performance, with 91.80 Top 1 accuracy and 88.46 mean accuracy for element actions, which are 3.40 and 7.26 higher than the previous best results.


Optimizing Rayleigh quotient with symmetric constraints and their applications to perturbations of the structured polynomial eigenvalue problem. For a Hermitian matrix H in mathbb C n,n and symmetric matrices S 0, S 1, ldots,S k in mathbb C n,n , we consider the problem of computing the supremum of left frac v Hv v v v in mathbb C n setminus 0 , ,v TS iv 0 text for i 0, ldots,k right . For this, we derive an estimation in the form of minimizing the second largest eigenvalue of a parameter depending Hermitian matrix, which is exact when the eigenvalue at the optimal is simple. The results are then applied to compute the eigenvalue backward errors of higher degree matrix polynomials with T palindromic, T antipalindromic, T even, T odd, and skew symmetric structures. The results are illustrated by numerical experiments.


Generalized associative algebras. We study diverse parametrized versions of the operad of associative algebra, where the parameter are taken in an associative semigroup Omega (generalization of matching or family associative algebras) or in its cartesian square (two parameters associative algebras). We give a description of the free algebras on these operads, study their formal series and prove that they are Koszul when the set of parameters is finite. We also study operadic morphisms between the operad of classical associative algebras and these objects, and links with other types of algebras (diassociative, dendriform, post Lie...).


A Comprehensive Review of the Video to Text Problem. Research in the Vision and Language area encompasses challenging topics that seek to connect visual and textual information. When the visual information is related to videos, this takes us into Video Text Research, which includes several challenging tasks such as video question answering, video summarization with natural language, and video to text and text to video conversion. This paper reviews the video to text problem, in which the goal is to associate an input video with its textual description. This association can be mainly made by retrieving the most relevant descriptions from a corpus or generating a new one given a context video. These two ways represent essential tasks for Computer Vision and Natural Language Processing communities, called text retrieval from video task and video captioning description task. These two tasks are substantially more complex than predicting or retrieving a single sentence from an image. The spatiotemporal information present in videos introduces diversity and complexity regarding the visual content and the structure of associated language descriptions. This review categorizes and describes the state of the art techniques for the video to text problem. It covers the main video to text methods and the ways to evaluate their performance. We analyze twenty six benchmark datasets, showing their drawbacks and strengths for the problem requirements. We also show the progress that researchers have made on each dataset, we cover the challenges in the field, and we discuss future research directions.


Powerline Tracking with Event Cameras. Autonomous inspection of powerlines with quadrotors is challenging. Flights require persistent perception to keep a close look at the lines. We propose a method that uses event cameras to robustly track powerlines. Event cameras are inherently robust to motion blur, have low latency, and high dynamic range. Such properties are advantageous for autonomous inspection of powerlines with drones, where fast motions and challenging illumination conditions are ordinary. Our method identifies lines in the stream of events by detecting planes in the spatio temporal signal, and tracks them through time. The implementation runs onboard and is capable of detecting multiple distinct lines in real time with rates of up to 320 thousand events per second. The performance is evaluated in real world flights along a powerline. The tracker is able to persistently track the powerlines, with a mean lifetime of the line 10 times longer than existing approaches.


Evacuating from ell p Unit Disks in the Wireless Model. The search type problem of evacuating 2 robots in the wireless model from the (Euclidean) unit disk was first introduced and studied by Czyzowicz et al. DISC'2014 . Since then, the problem has seen a long list of follow up results pertaining to variations as well as to upper and lower bound improvements. All established results in the area study this 2 dimensional search type problem in the Euclidean metric space where the search space, i.e. the unit disk, enjoys significant (metric) symmetries. We initiate and study the problem of evacuating 2 robots in the wireless model from ell p unit disks, p in 1, infty) , where in particular robots' moves are measured in the underlying metric space. To the best of our knowledge, this is the first study of a search type problem with mobile agents in more general metric spaces. The problem is particularly challenging since even the circumference of the ell p unit disks have been the subject of technical studies. In our main result, and after identifying and utilizing the very few symmetries of ell p unit disks, we design emph optimal evacuation algorithms that vary with p . Our main technical contributions are two fold. First, in our upper bound results, we provide (nearly) closed formulae for the worst case cost of our algorithms. Second, and most importantly, our lower bounds' arguments reduce to a novel observation in convex geometry which analyzes trade offs between arc and chord lengths of ell p unit disks as the endpoints of the arcs (chords) change position around the perimeter of the disk, which we believe is interesting in its own right. Part of our argument pertaining to the latter property relies on a computer assisted numerical verification that can be done for non extreme values of p .


FCAF3D Fully Convolutional Anchor Free 3D Object Detection. Recently, promising applications in robotics and augmented reality have attracted considerable attention to 3D object detection from point clouds. In this paper, we present FCAF3D a first in class fully convolutional anchor free indoor 3D object detection method. It is a simple yet effective method that uses a voxel representation of a point cloud and processes voxels with sparse convolutions. FCAF3D can handle large scale scenes with minimal runtime through a single fully convolutional feed forward pass. Existing 3D object detection methods make prior assumptions on the geometry of objects, and we argue that it limits their generalization ability. To get rid of any prior assumptions, we propose a novel parametrization of oriented bounding boxes that allows obtaining better results in a purely data driven way. The proposed method achieves state of the art 3D object detection results in terms of mAP 0.5 on ScanNet V2 ( 4.5), SUN RGB D ( 3.5), and S3DIS ( 20.5) datasets. The code and models are available at https github.com samsunglabs fcaf3d.


A Unified MPC Framework for Whole Body Dynamic Locomotion and Manipulation. In this paper, we propose a whole body planning framework that unifies dynamic locomotion and manipulation tasks by formulating a single multi contact optimal control problem. We model the hybrid nature of a generic multi limbed mobile manipulator as a switched system, and introduce a set of constraints that can encode any pre defined gait sequence or manipulation schedule in the formulation. Since the system is designed to actively manipulate its environment, the equations of motion are composed by augmenting the robot's centroidal dynamics with the manipulated object dynamics. This allows us to describe any high level task in the same cost constraint function. The resulting planning framework could be solved on the robot's onboard computer in real time within a model predictive control scheme. This is demonstrated in a set of real hardware experiments done in free motion, such as base or end effector pose tracking, and while pushing pulling a heavy resistive door. Robustness against model mismatches and external disturbances is also verified during these test cases.


Teaching Physics by Arduino during COVID 19 Pandemic The Free Falling Body Experiment. One of the difficulties related to the COVID 19 pandemic is the shifting from face to face to distance teaching. Both schools and universities had suddenly to organize on line lectures. To perform laboratory practice even in this period, easily accessible materials, smartphones physics apps, on line tools and devices can be used. In this paper a method to measure the gravitational acceleration studying the free falling body using Arduino board is presented.


Model Order Reduction based on Direct Normal Form Application to Large Finite Element MEMS Structures Featuring Internal Resonance. Dimensionality reduction in mechanical vibratory systems poses challenges for distributed structures including geometric nonlinearities, mainly because of the lack of invariance of the linear subspaces. A reduction method based on direct normal form computation for large finite element (FE) models is here detailed. The main advantage resides in operating directly from the physical space, hence avoiding the computation of the complete eigenfunctions spectrum. Explicit solutions are given, thus enabling a fully non intrusive version of the reduction method. The reduced dynamics is obtained from the normal form of the geometrically nonlinear mechanical problem, free of non resonant monomials, and truncated to the selected master coordinates, thus making a direct link with the parametrisation of invariant manifolds. The method is fully expressed with a complex valued formalism by detailing the homological equations in a systematic manner, and the link with real valued expressions is established. A special emphasis is put on the treatment of second order internal resonances and the specific case of a 1 2 resonance is made explicit. Finally, applications to large scale models of Micro Electro Mechanical structures featuring 1 2 and 1 3 resonances are reported, along with considerations on computational efficiency.


Transferability of Neural Network Clinical De identification Systems. Objective Neural network de identification studies have focused on individual datasets. These studies assume the availability of a sufficient amount of human annotated data to train models that can generalize to corresponding test data. In real world situations, however, researchers often have limited or no in house training data. Existing systems and external data can help jump start de identification on in house data however, the most efficient way of utilizing existing systems and external data is unclear. This article investigates the transferability of a state of the art neural clinical de identification system, NeuroNER, across a variety of datasets, when it is modified architecturally for domain generalization and when it is trained strategically for domain transfer. Methods and Materials We conducted a comparative study of the transferability of NeuroNER using four clinical note corpora with multiple note types from two institutions. We modified NeuroNER architecturally to integrate two types of domain generalization approaches. We evaluated each architecture using three training strategies. We measured transferability from external sources transferability across note types the contribution of external source data when in domain training data are available and transferability across institutions. Results and Conclusions Transferability from a single external source gave inconsistent results. Using additional external sources consistently yielded an F1 score of approximately 80 . Fine tuning emerged as a dominant transfer strategy, with or without domain generalization. We also found that external sources were useful even in cases where in domain training data were available. Transferability across institutions differed by note type and annotation label but resulted in improved performance.


Rule Based Reinforcement Learning for Efficient Robot Navigation with Space Reduction. For real world deployments, it is critical to allow robots to navigate in complex environments autonomously. Traditional methods usually maintain an internal map of the environment, and then design several simple rules, in conjunction with a localization and planning approach, to navigate through the internal map. These approaches often involve a variety of assumptions and prior knowledge. In contrast, recent reinforcement learning (RL) methods can provide a model free, self learning mechanism as the robot interacts with an initially unknown environment, but are expensive to deploy in real world scenarios due to inefficient exploration. In this paper, we focus on efficient navigation with the RL technique and combine the advantages of these two kinds of methods into a rule based RL (RuRL) algorithm for reducing the sample complexity and cost of time. First, we use the rule of wall following to generate a closed loop trajectory. Second, we employ a reduction rule to shrink the trajectory, which in turn effectively reduces the redundant exploration space. Besides, we give the detailed theoretical guarantee that the optimal navigation path is still in the reduced space. Third, in the reduced space, we utilize the Pledge rule to guide the exploration strategy for accelerating the RL process at the early stage. Experiments conducted on real robot navigation problems in hex grid environments demonstrate that RuRL can achieve improved navigation performance.


Extended Larch 'e Cahn framework for reactive Cahn Hilliard multicomponent systems. At high temperature and pressure, solid diffusion and chemical reactions between rock minerals lead to phase transformations. Chemical transport during uphill diffusion causes phase separation, that is, spinodal decomposition. Thus, to describe the coarsening kinetics of the exsolution microstructure, we derive a thermodynamically consistent continuum theory for the multicomponent Cahn Hilliard equations while accounting for multiple chemical reactions and neglecting deformations. Our approach considers multiple balances of microforces augmented by multiple constituent content balance equations within an extended Larch 'e Cahn framework. As for the Larch 'e Cahn framework, we incorporate into the theory the Larch 'e Cahn derivatives with respect to the phase fields and their gradients. We also explain the implications of the resulting constrained gradients of the phase fields in the form of the gradient energy coefficients. Moreover, we derive a configurational balance that includes all the associated configurational fields in agreement with the Larch 'e Cahn framework. We study phase separation in a three component system whose microstructural evolution depends upon the reaction diffusion interactions and to analyze the underlying configurational fields. This simulation portrays the interleaving between the reaction and diffusion processes and how the configurational tractions drive the motion of interfaces.


Inductive and Coinductive Topological Generation with Church's thesis and the Axiom of Choice. Here we consider an extension MFcind of the Minimalist Foundation MF for predicative constructive mathematics with the addition of inductive and coinductive definitions sufficient to generate Sambin's Positive topologies, i.e. Martin L "of Sambin formal topologies equipped with a Positivity relation (used to describe pointfree formal closed subsets). In particular the intensional level of MFcind, called mTTcind, is defined by extending with coinductive definitions another theory mTTind extending the intensional level mTT of MF with the sole addition of inductive definitions. In previous work we have shown that mTTind is consistent with Formal Church's Thesis CT and the Axiom of Choice AC via an interpretation in Aczel's CZF REA. Our aim is to show the expectation that the addition of coinductive definitions to mTTind does not increase its consistency strength by reducing the consistency of mTTcind CT AC to the consistency of CZF REA through various interpretations. We actually reach our goal in two ways. One way consists in first interpreting mTTcind CT AC in the theory extending CZF with the Union Regular Extension Axiom, REA U, a strengthening of REA, and the Axiom of Relativized Dependent Choice, RDC. The theory CZF REA U RDC is then interpreted in MLS , a version of Martin L "of's type theory with Palmgren's superuniverse S. A last step consists in interpreting MLS back into CZF REA. The alternative way consists in first interpreting mTTcind AC CT directly in a version of Martin L "of's type theory with Palmgren's superuniverse extended with CT, which is then interpreted back to CZF REA. A key benefit of the first way is that the theory CZF REA U RDC also supports the intended set theoretic interpretation of the extensional level of MFcind. Finally, all the theories considered, except mTTcind AC CT, are shown to be of the same proof theoretic strength.


Cold Gas Plasma Sources and the Science behind their Applications in Biology and Medicine. Studies on the interaction of plasma generated at atmospheric pressure and at room temperature (low temperature plasma or just cold plasma) with biological cells and tissues have revealed that cold plasma has therapeutic effects that form the basis for new medical therapies. Cold plasma exhibits bactericidal properties and at low doses can modulate cell functions, including proliferation, attachment, and migration. Research in the last two decades has shown that cold plasma can be used for wound healing and can kill cancer cells in a selective manner. This paper describes the fundamental science behind the biomedical applications of cold plasma.


A Layered Grouping Random Access Scheme Based on Dynamic Preamble Selection for Massive Machine Type Communications. Massive machine type communication (mMTC) has been identified as an important use case in Beyond 5G networks and future massive Internet of Things (IoT). However, for the massive multiple access in mMTC, there is a serious access preamble collision problem if the conventional 4 step random access (RA) scheme is employed. Consequently, a range of grantfree (GF) RA schemes were proposed. Nevertheless, if the number of cellular users (devices) significantly increases, both the energy and spectrum efficiency of the existing GF schemes still rapidly degrade owing to the much longer preambles required. In order to overcome this dilemma, a layered grouping strategy is proposed, where the cellular users are firstly divided into clusters based on their geographical locations, and then the users of the same cluster autonomously join in different groups by using optimum energy consumption (Opt EC) based K means algorithm. With this new layered cellular architecture, the RA process is divided into cluster load estimation phase and active group detection phase. Based on the state evolution theory of approximated message passing algorithm, a tight lower bound on the minimum preamble length for achieving a certain detection accuracy is derived. Benefiting from the cluster load estimation, a dynamic preamble selection (DPS) strategy is invoked in the second phase, resulting the required preambles with minimum length. As evidenced in our simulation results, this two phase DPS aided RA strategy results in a significant performance improvement


Predictive Quality of Service (PQoS) The Next Frontier for Fully Autonomous Systems. Recent advances in software, hardware, computing and control have fueled significant progress in the field of autonomous systems. Notably, autonomous machines should continuously estimate how the scenario in which they move and operate will evolve within a predefined time frame, and foresee whether or not the network will be able to fulfill the agreed Quality of Service (QoS). If not, appropriate countermeasures should be taken to satisfy the application requirements. Along these lines, in this paper we present possible methods to enable predictive QoS (PQoS) in autonomous systems, and discuss which use cases will particularly benefit from network prediction. Then, we shed light on the challenges in the field that are still open for future research. As a case study, we demonstrate whether machine learning can facilitate PQoS in a teleoperated driving like use case, as a function of different measurement signals.


Feature Encoding with AutoEncoders for Weakly supervised Anomaly Detection. Weakly supervised anomaly detection aims at learning an anomaly detector from a limited amount of labeled data and abundant unlabeled data. Recent works build deep neural networks for anomaly detection by discriminatively mapping the normal samples and abnormal samples to different regions in the feature space or fitting different distributions. However, due to the limited number of annotated anomaly samples, directly training networks with the discriminative loss may not be sufficient. To overcome this issue, this paper proposes a novel strategy to transform the input data into a more meaningful representation that could be used for anomaly detection. Specifically, we leverage an autoencoder to encode the input data and utilize three factors, hidden representation, reconstruction residual vector, and reconstruction error, as the new representation for the input data. This representation amounts to encode a test sample with its projection on the training data manifold, its direction to its projection and its distance to its projection. In addition to this encoding, we also propose a novel network architecture to seamlessly incorporate those three factors. From our extensive experiments, the benefits of the proposed strategy are clearly demonstrated by its superior performance over the competitive methods.


Ranking Distance Calibration for Cross Domain Few Shot Learning. Recent progress in few shot learning promotes a more realistic cross domain setting, where the source and target datasets are from different domains. Due to the domain gap and disjoint label spaces between source and target datasets, their shared knowledge is extremely limited. This encourages us to explore more information in the target domain rather than to overly elaborate training strategies on the source domain as in many existing methods. Hence, we start from a generic representation pre trained by a cross entropy loss and a conventional distance based classifier, along with an image retrieval view, to employ a re ranking process for calibrating a target distance matrix by discovering the reciprocal k nearest neighbours within the task. Assuming the pre trained representation is biased towards the source, we construct a non linear subspace to minimise task irrelevant features therewithin while keep more transferrable discriminative information by a hyperbolic tangent transformation. The calibrated distance in this target aware non linear subspace is complementary to that in the pre trained representation. To impose such distance calibration information onto the pre trained representation, a Kullback Leibler divergence loss is employed to gradually guide the model towards the calibrated distance based distribution. Extensive evaluations on eight target domains show that this target ranking calibration process can improve conventional distance based classifiers in few shot learning.


Machine Translationese Effects of Algorithmic Bias on Linguistic Complexity in Machine Translation. Recent studies in the field of Machine Translation (MT) and Natural Language Processing (NLP) have shown that existing models amplify biases observed in the training data. The amplification of biases in language technology has mainly been examined with respect to specific phenomena, such as gender bias. In this work, we go beyond the study of gender in MT and investigate how bias amplification might affect language in a broader sense. We hypothesize that the 'algorithmic bias', i.e. an exacerbation of frequently observed patterns in combination with a loss of less frequent ones, not only exacerbates societal biases present in current datasets but could also lead to an artificially impoverished language 'machine translationese'. We assess the linguistic richness (on a lexical and morphological level) of translations created by different data driven MT paradigms phrase based statistical (PB SMT) and neural MT (NMT). Our experiments show that there is a loss of lexical and morphological richness in the translations produced by all investigated MT paradigms for two language pairs (EN FR and EN ES).


Categorical Data Structures for Technical Computing. Many mathematical objects can be represented as functors from finitely presented categories mathsf C to mathsf Set . For instance, graphs are functors to mathsf Set from the category with two parallel arrows. Such functors are known informally as mathsf C sets. In this paper, we describe and implement an extension of mathsf C sets having data attributes with fixed types, such as graphs with labeled vertices or real valued edge weights. We call such structures "acsets," short for "attributed mathsf C sets." Derived from previous work on algebraic databases, acsets are a joint generalization of graphs and data frames. They also encompass more elaborate graph like objects such as wiring diagrams and Petri nets with rate constants. We develop the mathematical theory of acsets and then describe a generic implementation in the Julia programming language, which uses advanced language features to achieve performance comparable with specialized data structures.


A Lightweight and Scalable Physical Layer Attack Detection Mechanism for the Internet of Things (IoT) Using Hybrid Security Schema. The Internet of Things, also known as the IoT, refers to the billions of devices around the world that are now connected to the Internet, collecting and sharing data. The amount of data collected through IoT sensors must be completely securely controlled. To protect the information collected by IoT sensors, a lightweight method called Discover the Flooding Attack RPL (DFA RPL) has been proposed. The proposed DFA RPL method identifies intrusive nodes in several steps to exclude them from continuing routing operations. Thus, in the DFA RPL method, it first builds a cluster and selects the most appropriate node as a cluster head in DODAG, then, due to the vulnerability of the RPL protocol to Flooding attacks, it uses an ant colony algorithm (ACO) using five steps to detect attacks. Use Flooding to prevent malicious activity on the IoT network. In other words, if it detects a node as malicious, it puts that node on the detention list and quarantines it for a certain period of time. The results obtained from the simulation show the superiority of the proposed method in terms of Packet Delivery Rate, Detection Rate, False Positive Rate, and False Negative Rate compared to IRAD and REATO methods.


The Cost of Compositionality A High Performance Implementation of String Diagram Composition. String diagrams are an increasingly popular algebraic language for the analysis of graphical models of computations across different research fields. Whereas string diagrams have been thoroughly studied as semantic structures, much fewer attention has been given to their algorithmic properties, and efficient implementations of diagrammatic reasoning are almost an unexplored subject. This work intends to be a contribution in such direction. We introduce a data structure representing string diagrams in terms of adjacency matrices. This encoding has the key advantage of providing simple and efficient algorithms for composition and tensor product of diagrams. We demonstrate its effectiveness by showing that the complexity of the two operations is linear in the size of string diagrams. Also, as our approach is based on basic linear algebraic operations, we can take advantage of heavily optimised implementations, which we use to measure performances of string diagrammatic operations via several benchmarks.


A New, Computationally Efficient "Blech Criterion" for Immortality in General Interconnects. Traditional methodologies for analyzing electromigration (EM) in VLSI circuits first filter immortal wires using Blech's criterion, and then perform detailed EM analysis on the remaining wires. However, Blech's criterion was designed for two terminal wires and does not extend to general structures. This paper demonstrates a first principles based solution technique for determining the steady state stress at all the nodes of a general interconnect structure, and develops an immortality test whose complexity is linear in the number of edges of an interconnect structure. The proposed model is applied to a variety of structures. The method is shown to match well with results from numerical solvers, to be scalable to large structures.


Prediction of Hydraulic Blockage at Cross Drainage Structures using Regression Analysis. Hydraulic blockage of cross drainage structures such as culverts is considered one of main contributor in triggering urban flash floods. However, due to lack of during floods data and highly non linear nature of debris interaction, conventional modelling for hydraulic blockage is not possible. This paper proposes to use machine learning regression analysis for the prediction of hydraulic blockage. Relevant data has been collected by performing a scaled in lab study and replicating different blockage scenarios. From the regression analysis, Artificial Neural Network (ANN) was reported best in hydraulic blockage prediction with R 2 of 0.89. With deployment of hydraulic sensors in smart cities, and availability of Big Data, regression analysis may prove helpful in addressing the blockage detection problem which is difficult to counter using conventional experimental and hydrological approaches.


Truthful Information Elicitation from Hybrid Crowds. Suppose a decision maker wants to predict weather tomorrow by eliciting and aggregating information from crowd. How can the decision maker incentivize the crowds to report their information truthfully? Many truthful peer prediction mechanisms have been proposed for homogeneous agents, whose types are drawn from the same distribution. However, in many situations, the population is a hybrid crowd of different types of agents with different forms of information, and the decision maker has neither the identity of any individual nor the proportion of each types of agents in the crowd. Ignoring the heterogeneity among the agent may lead to inefficient of biased information, which would in turn lead to suboptimal decisions. In this paper, we propose the first framework for information elicitation from hybrid crowds, and two mechanisms to motivate agents to report their information truthfully. The first mechanism combines two mechanisms via linear transformations and the second is based on mutual information. With two mechanisms, the decision maker can collect high quality information from hybrid crowds, and learns the expertise of agents.