Discriminative Latent Semantic Graph for Video Captioning. Video captioning aims to automatically generate natural language sentences that can describe the visual contents of a given video. Existing generative models like encoder decoder frameworks cannot explicitly explore the object level interactions and frame level information from complex spatio temporal data to generate semantic rich captions. Our main contribution is to identify three key problems in a joint framework for future video summarization tasks. 1) Enhanced Object Proposal we propose a novel Conditional Graph that can fuse spatio temporal information into latent object proposal. 2) Visual Knowledge Latent Proposal Aggregation is proposed to dynamically extract visual words with higher semantic levels. 3) Sentence Validation A novel Discriminative Language Validator is proposed to verify generated captions so that key semantic concepts can be effectively preserved. Our experiments on two public datasets (MVSD and MSR VTT) manifest significant improvements over state of the art approaches on all metrics, especially for BLEU 4 and CIDEr. Our code is available at https github.com baiyang4 D LSG Video Caption.


Inverted GaInP GaAs Three Terminal Heterojunction Bipolar Transistor Solar Cell. Here we present the experimental results of an inverted three terminal heterojunction bipolar transistor solar cell (HBTSC) made of GaInP GaAs. The inverted growth and processing enable contacting the intermediate layer (base) from the bottom, which improves the cell performance by reducing shadow factor and series resistance at the same time. With this prototype we show that an inverted processing of a three terminal solar cell is feasible and pave the way for the application of epitaxial lift off, substrate reuse and mechanical stacking to the HBTSC which can eventually lead to a low cost high efficiency III V on Si HBTSC technology.


Let Your Heart Speak in its Mother Tongue Multilingual Captioning of Cardiac Signals. Cardiac signals, such as the electrocardiogram, convey a significant amount of information about the health status of a patient which is typically summarized by a clinician in the form of a clinical report, a cumbersome process that is prone to errors. To streamline this routine process, we propose a deep neural network capable of captioning cardiac signals it receives a cardiac signal as input and generates a clinical report as output. We extend this further to generate multilingual reports. To that end, we create and make publicly available a multilingual clinical report dataset. In the absence of sufficient labelled data, deep neural networks can benefit from a warm start, or pre training, procedure in which parameters are first learned in an arbitrary task. We propose such a task in the form of discriminative multilingual pre training where tokens from clinical reports are randomly replaced with those from other languages and the network is tasked with predicting the language of all tokens. We show that our method performs on par with state of the art pre training methods such as MLM, ELECTRA, and MARGE, while simultaneously generating diverse and plausible clinical reports. We also demonstrate that multilingual models can outperform their monolingual counterparts, informally terming this beneficial phenomenon as the blessing of multilinguality.


Applying the Cz 'edli Schmidt Sequences to congruence properties of planar semimodular lattices. Following G. Gr "atzer and E. Knapp, 2009, a planar semimodular lattice L is emph rectangular , if the left boundary chain has exactly one doubly irreducible element, c l , and the right boundary chain has exactly one doubly irreducible element, c r , and these elements are complementary. The Cz 'edli Schmidt Sequences, introduced in 2012, construct rectangular lattices. We use them to prove some structure theorems. In particular, we prove that for a slim (no mathsf M 3 sublattice) rectangular lattice L , the congruence lattice Con L has exactly length c l,1 length c r,1 dual atoms and a dual atom in Con L is a congruence with exactly two classes. We also describe the prime ideals in a slim rectangular lattice.


Theory of Mind Based Assistive Communication in Complex Human Robot Cooperation. When cooperating with a human, a robot should not only care about its environment and task but also develop an understanding of the partner's reasoning. To support its human partner in complex tasks, the robot can share information that it knows. However simply communicating everything will annoy and distract humans since they might already be aware of and not all information is relevant in the current situation. The questions when and what type of information the human needs, are addressed through the concept of Theory of Mind based Communication which selects information sharing actions based on evaluation of relevance and an estimation of human beliefs. We integrate this into a communication assistant to support humans in a cooperative setting and evaluate performance benefits. We designed a human robot Sushi making task that is challenging for the human and generates different situations where humans are unaware and communication could be beneficial. We evaluate the influence of the human centric communication concept on performance with a user study. Compared to the condition without information exchange, assisted participants can recover from unawareness much earlier. The approach respects the costs of communication and balances interruptions better than other approaches. By providing information adapted to specific situations, the robot does not instruct but enable the human to make good decision.


Robust Navigation for Racing Drones based on Imitation Learning and Modularization. This paper presents a vision based modularized drone racing navigation system that uses a customized convolutional neural network (CNN) for the perception module to produce high level navigation commands and then leverages a state of the art planner and controller to generate low level control commands, thus exploiting the advantages of both data based and model based approaches. Unlike the state of the art method which only takes the current camera image as the CNN input, we further add the latest three drone states as part of the inputs. Our method outperforms the state of the art method in various track layouts and offers two switchable navigation behaviors with a single trained network. The CNN based perception module is trained to imitate an expert policy that automatically generates ground truth navigation commands based on the pre computed global trajectories. Owing to the extensive randomization and our modified dataset aggregation (DAgger) policy during data collection, our navigation system, which is purely trained in simulation with synthetic textures, successfully operates in environments with randomly chosen photorealistic textures without further fine tuning.


Patch Craft Video Denoising by Deep Modeling and Patch Matching. The non local self similarity property of natural images has been exploited extensively for solving various image processing problems. When it comes to video sequences, harnessing this force is even more beneficial due to the temporal redundancy. In the context of image and video denoising, many classically oriented algorithms employ self similarity, splitting the data into overlapping patches, gathering groups of similar ones and processing these together somehow. With the emergence of convolutional neural networks (CNN), the patch based framework has been abandoned. Most CNN denoisers operate on the whole image, leveraging non local relations only implicitly by using a large receptive field. This work proposes a novel approach for leveraging self similarity in the context of video denoising, while still relying on a regular convolutional architecture. We introduce a concept of patch craft frames artificial frames that are similar to the real ones, built by tiling matched patches. Our algorithm augments video sequences with patch craft frames and feeds them to a CNN. We demonstrate the substantial boost in denoising performance obtained with the proposed approach.


Emergence of a periodically rotating one point cluster in a thermodynamic Cucker Smale ensemble. We study emergent behaviors of thermomechanical Cucker Smale (TCS) ensemble confined in a harmonic potential field. In the absence of external force field, emergent dynamics of TCS particles has been extensively studied recently under various frameworks formulated in terms of initial configuration, system parameters and network topologies. Moreover, the TCS model does not exhibit rotating motions in the absence of an external force field. In this paper, we show the emergence of periodically rotating one point cluster for the TCS model in a harmonic potential field using elementary energy estimates and continuity argument. We also provide several numerical simulations and compare them with analytical results.


On a supersonic sonic patch arising from the Frankl problem in transonic flows. We construct a supersonic sonic smooth patch solution for the two dimensional steady Euler equations in gas dynamics. This patch is extracted from the Frankl problem in the study of transonic flow with local supersonic bubble over an airfoil. Based on the methodology of characteristic decompositions, we establish the global existence and regularity of solutions in a partial hodograph coordinate system in terms of angle variables. The original problem is solved by transforming the solution in the partial hodograph plane back to that in the physical plane. Moreover, the uniform regularity of the solution and the regularity of an associated sonic curve are also verified.


Causally motivated Shortcut Removal Using Auxiliary Labels. Shortcut learning, in which models make use of easy to represent but unstable associations, is a major failure mode for robust machine learning. We study a flexible, causally motivated approach to training robust predictors by discouraging the use of specific shortcuts, focusing on a common setting where a robust predictor could achieve optimal emph iid generalization in principle, but is overshadowed by a shortcut predictor in practice. Our approach uses auxiliary labels, typically available at training time, to enforce conditional independences implied by the causal graph. We show both theoretically and empirically that causally motivated regularization schemes (a) lead to more robust estimators that generalize well under distribution shift, and (b) have better finite sample efficiency compared to usual regularization schemes, even when no shortcut is present. Our analysis highlights important theoretical properties of training techniques commonly used in the causal inference, fairness, and disentanglement literatures. Our code is available at https github.com mymakar causally motivated shortcut removal


Singular solutions, graded meshes, and adaptivity for total variation regularized minimization problems. Recent quasi optimal error estimates for the finite element approximation of total variation regularized minimization problems require the existence of a Lipschitz continuous dual solution. We discuss the validity of this condition and devise numerical methods using locally refined meshes that lead to improved convergence rates despite the occurrence of discontinuities. It turns out that nearly linear convergence is possible on suitably constructed meshes.


Graph Infomax Adversarial Learning for Treatment Effect Estimation with Networked Observational Data. Treatment effect estimation from observational data is a critical research topic across many domains. The foremost challenge in treatment effect estimation is how to capture hidden confounders. Recently, the growing availability of networked observational data offers a new opportunity to deal with the issue of hidden confounders. Unlike networked data in traditional graph learning tasks, such as node classification and link detection, the networked data under the causal inference problem has its particularity, i.e., imbalanced network structure. In this paper, we propose a Graph Infomax Adversarial Learning (GIAL) model for treatment effect estimation, which makes full use of the network structure to capture more information by recognizing the imbalance in network structure. We evaluate the performance of our GIAL model on two benchmark datasets, and the results demonstrate superiority over the state of the art methods.


On (r,D,R) Blaschke Santal 'o diagrams with regular k gon gauges. We provide a study of Blaschke Santal 'o diagrams for the inradius, diameter, and circumradius, measured with respect to different gauges. This contrasts previous works on those diagrams, which are all considered for euclidean measure. By proving several new inequalities and properties between these three functionals, we compute the intersection and the union over all possible gauges of those diagrams, showing that they coincide with the corresponding diagrams of a parallelotope and (in the planar case) a triangle, respectively. Further new extremal properties are derived considering the diagrams with respect to a regular pentagon or hexagon gauge.


Optimal efficiency of high frequency chest wall oscillations and links with resistance and compliance in a model of the lung. Chest physiotherapy is a set of techniques used to help the draining of the mucus from the lung in pathological situations. The choice of the techniques, and their adjustment to the patients or to the pathologies, remains as of today largely empirical. High Frequency Chest Wall Oscillation (HFCWO) is one of these techniques, performed with a device that applies oscillating pressures on the chest. However, there is no clear understanding of how HFCWO devices interact with the lung biomechanics. Hence, we study idealised HFCWO manipulations applied to a mathematical and numerical model of the biomechanics of the lung. The lung is represented by a fluid structure interaction model based on an airway tree that is coupled to an homogeneous elastic medium. We show that our model is driven by two dimensionless numbers that drive the effect of the idealised HFCWO manipulation on the model of the lung. Our model allow to analyze the stress applied to an idealised mucus by the air mucus interaction and by the airway walls deformation. This stress behaves as a buffer and has the effect of reducing the stress needed to overcome the idealised mucus yield stress. Moreover, our model predicts the existence of an optimal range of the working frequencies of HFCWO. This range is in agreement with the frequencies actually used by practitioners during HFCWO maneuvers. Finally, our model suggests that analyzing the mouth airflow during HFCWO maneuvers could allow to estimate the compliance and the hydrodynamic resistance of the lung of a patient.


Multilevel Stein variational gradient descent with applications to Bayesian inverse problems. This work presents a multilevel variant of Stein variational gradient descent to more efficiently sample from target distributions. The key ingredient is a sequence of distributions with growing fidelity and costs that converges to the target distribution of interest. For example, such a sequence of distributions is given by a hierarchy of ever finer discretization levels of the forward model in Bayesian inverse problems. The proposed multilevel Stein variational gradient descent moves most of the iterations to lower, cheaper levels with the aim of requiring only a few iterations on the higher, more expensive levels when compared to the traditional, single level Stein variational gradient descent variant that uses the highest level distribution only. Under certain assumptions, in the mean field limit, the error of the proposed multilevel Stein method decays by a log factor faster than the error of the single level counterpart with respect to computational costs. Numerical experiments with Bayesian inverse problems show speedups of more than one order of magnitude of the proposed multilevel Stein method compared to the single level variant that uses the highest level only.


Quantitative optical coherence tomography reveals rod photoreceptor degeneration in early diabetic retinopathy. Purpose This study is to test the feasibility of optical coherence tomography (OCT) detection of photoreceptor abnormality and to verify the photoreceptor abnormality is rod predominated in early DR . Methods OCT images were acquired from normal eyes, diabetic eyes with no diabetic retinopathy (NoDR) and mild DR. Quantitative features, including length features quantifying band distances and reflectance intensity features among the external limiting membrane (ELM), inner segment ellipsoid (ISe), interdigitation zone (IZ) and retinal pigment epithelium (RPE) were determined. Comparative OCT analysis of central fovea, parafovea and perifovea were implemented to verify the photoreceptor abnormality is rod predominated in early DR. Results Length abnormalities between the ISe and IZ also showed a decreasing trend among cohorts. Reflectance abnormalities of the ELM, IZ and ISe were observed between healthy, NoDR, and Mild DR eyes. The normalized ISe RPE intensity ratio revealed a significant decreasing trend in the perifovea, but no detectable difference in central fovea. Conclusions Quantitative OCT analysis consistently revealed outer retina, i.e., photoreceptor, changes in diabetic patients with NoDR and mild DR. Comparative analysis of central fovea, parafovea and perifovea confirmed the photoreceptor abnormality is rod predominated in early DR.


Tracing Affordance and Item Adoption on Music Streaming Platforms. Popular music streaming platforms offer users a diverse network of content exploration through a triad of affordances organic, algorithmic and editorial access modes. Whilst offering great potential for discovery, such platform developments also pose the modern user with daily adoption decisions on two fronts platform affordance adoption and the adoption of recommendations therein. Following a carefully constrained set of Deezer users over a 2 year observation period, our work explores factors driving user behaviour in the broad sense, by differentiating users on the basis of their temporal daily usage, adoption of the main platform affordances, and the ways in which they react to them, especially in terms of recommendation adoption. Diverging from a perspective common in studies on the effects of recommendation, we assume and confirm that users exhibit very diverse behaviours in using and adopting the platform affordances. The resulting complex and quite heterogeneous picture demonstrates that there is no blanket answer for adoption practices of both recommendation features and recommendations.


Pure pairs. IX. Transversal trees. Fix k 0, and let G be a graph, with vertex set partitioned into k subsets ( blocks') of approximately equal size. An induced subgraph of G is transversal (with respect to this partition) if it has exactly one vertex in each block (and therefore it has exactly k vertices). A pure pair in G is a pair X,Y of disjoint subsets of V(G) such that either all edges between X,Y are present or none are and in the present context we are interested in pure pairs (X,Y) where each of X,Y is a subset of one of the blocks, and not the same block. This paper collects several results and open questions concerning how large a pure pair must be present if various types of transversal subgraphs are excluded.


Online Multi Granularity Distillation for GAN Compression. Generative Adversarial Networks (GANs) have witnessed prevailing success in yielding outstanding images, however, they are burdensome to deploy on resource constrained devices due to ponderous computational costs and hulking memory usage. Although recent efforts on compressing GANs have acquired remarkable results, they still exist potential model redundancies and can be further compressed. To solve this issue, we propose a novel online multi granularity distillation (OMGD) scheme to obtain lightweight GANs, which contributes to generating high fidelity images with low computational demands. We offer the first attempt to popularize single stage online distillation for GAN oriented compression, where the progressively promoted teacher generator helps to refine the discriminator free based student generator. Complementary teacher generators and network layers provide comprehensive and multi granularity concepts to enhance visual fidelity from diverse dimensions. Experimental results on four benchmark datasets demonstrate that OMGD successes to compress 40x MACs and 82.5X parameters on Pix2Pix and CycleGAN, without loss of image quality. It reveals that OMGD provides a feasible solution for the deployment of real time image translation on resource constrained devices. Our code and models are made public at https github.com bytedance OMGD.


Improving Context Based Meta Reinforcement Learning with Self Supervised Trajectory Contrastive Learning. Meta reinforcement learning typically requires orders of magnitude more samples than single task reinforcement learning methods. This is because meta training needs to deal with more diverse distributions and train extra components such as context encoders. To address this, we propose a novel self supervised learning task, which we named Trajectory Contrastive Learning (TCL), to improve meta training. TCL adopts contrastive learning and trains a context encoder to predict whether two transition windows are sampled from the same trajectory. TCL leverages the natural hierarchical structure of context based meta RL and makes minimal assumptions, allowing it to be generally applicable to context based meta RL algorithms. It accelerates the training of context encoders and improves meta training overall. Experiments show that TCL performs better or comparably than a strong meta RL baseline in most of the environments on both meta RL MuJoCo (5 of 6) and Meta World benchmarks (44 out of 50).


CHEF A Cheap and Fast Pipeline for Iteratively Cleaning Label Uncertainties (Technical Report). High quality labels are expensive to obtain for many machine learning tasks, such as medical image classification tasks. Therefore, probabilistic (weak) labels produced by weak supervision tools are used to seed a process in which influential samples with weak labels are identified and cleaned by several human annotators to improve the model performance. To lower the overall cost and computational overhead of this process, we propose a solution called CHEF (CHEap and Fast label cleaning), which consists of the following three components. First, to reduce the cost of human annotators, we use Infl, which prioritizes the most influential training samples for cleaning and provides cleaned labels to save the cost of one human annotator. Second, to accelerate the sample selector phase and the model constructor phase, we use Increm Infl to incrementally produce influential samples, and DeltaGrad L to incrementally update the model. Third, we redesign the typical label cleaning pipeline so that human annotators iteratively clean smaller batch of samples rather than one big batch of samples. This yields better over all model performance and enables possible early termination when the expected model performance has been achieved. Extensive experiments show that our approach gives good model prediction performance while achieving significant speed ups.


On the spine of two particle Fleming Viot process driven by Brownian motion. The spine of two particles Fleming Viot process driven by Brownian motion is not a Bessel 3 process.


Deep ensembles in bioimage segmentation. Semantic segmentation consists in classifying each pixel of an image by assigning it to a specific label chosen from a set of all the available ones. During the last few years, a lot of attention shifted to this kind of task. Many computer vision researchers tried to apply autoencoder structures to develop models that can learn the semantics of the image as well as a low level representation of it. In an autoencoder architecture, given an input, an encoder computes a low dimensional representation of the input that is then used by a decoder to reconstruct the original data. In this work, we propose an ensemble of convolutional neural networks (CNNs). In ensemble methods, many different models are trained and then used for classification, the ensemble aggregates the outputs of the single classifiers. The approach leverages on differences of various classifiers to improve the performance of the whole system. Diversity among the single classifiers is enforced by using different loss functions. In particular, we present a new loss function that results from the combination of Dice and Structural Similarity Index. The proposed ensemble is implemented by combining different backbone networks using the DeepLabV3 and HarDNet environment. The proposal is evaluated through an extensive empirical evaluation on two real world scenarios polyp and skin segmentation. All the code is available online at https github.com LorisNanni.


Extending Partial Representations of Rectangular Duals with Given Contact Orientations. A rectangular dual of a graph G is a contact representation of G by axis aligned rectangles such that (i) no four rectangles share a point and (ii) the union of all rectangles is a rectangle. The partial representation extension problem for rectangular duals asks whether a given partial rectangular dual can be extended to a rectangular dual, that is, whether there exists a rectangular dual where some vertices are represented by prescribed rectangles. Combinatorially, a rectangular dual can be described by a regular edge labeling (REL), which determines the orientations of the rectangle contacts. We describe two approaches to solve the partial representation extension problem for rectangular duals with given REL. On the one hand, we characterise the RELs that admit an extension, which leads to a linear time testing algorithm. In the affirmative, we can construct an extension in linear time. This partial representation extension problem can also be formulated as a linear program (LP). We use this LP to solve the simultaneous representation problem for the case of rectangular duals when each input graph is given together with a REL.


The Fluid Dynamics of the One Body Stationary States of Quantum Mechanics with Real Valued Wavefunctions. It is demonstrated that the probability density function, given by the square of a quantum mechanical wavefunction that is a real valued eigenvector of a time independent, one body Schroedinger equation, satisfies a compressible flow generalization of the Bernoulli equation, where the mass density is the probability density times the mass of the system the pressure and velocity fields are defined by functions depending on the probability density, and the gradient and the Laplacian of the probability density, where there are two possible directions of the velocity on a streamline. The velocity given definition implies a generalization of the steady flow continuity equation where mass is not locally conserved. The gradient of the Bernoullian equation is demonstrated to be equivalent to the steady flow Euler equation for variable mass and irrotational flow. A speed of sound quadratic equation is obtained from a spherical wave pulse. One of the solutions indicates that the wave pulse velocity on a streamline is equal in magnitude but opposite in direction of the fluid velocity on the streamline. The other solution is the focus of attention from that point on. It is proven that the extremums of the momentum per volume on a streamline occur at points that are Mach 1 speed. The developed formalism is applied to a particle in a one dimensional box, the ground and first excited states of the one dimensional harmonic oscillator, and the hydrogen 1s and 2s states. Some behavior is repeated in all the applications examined. For example, an antinode, a point of local maximum density, has zero velocity and zero Mach speed on the streamline, while a node, a point of minimum density, has infinite velocity and Mach 2. In between the node and antinode is an extremum of the momentum, and Mach 1. (This is a short version of the abstract.)


Performance of the MICE diagnostic system. Muon beams of low emittance provide the basis for the intense, well characterised neutrino beams of a neutrino factory and for multi TeV lepton antilepton collisions at a muon collider. The international Muon Ionization Cooling Experiment (MICE) has demonstrated the principle of ionization cooling, the technique by which it is proposed to reduce the phase space volume occupied by the muon beam at such facilities. This paper documents the performance of the detectors used in MICE to measure the muon beam parameters, and the physical properties of the liquid hydrogen energy absorber during running.


Optimal potentials for hedging algorithms. We study a family of potential functions for online learning. We show that if the potential function has strictly positive derivatives of order 1 4 then the min max optimal strategy for the adversary is Brownian motion. Using that fact we analyze different potential functions and show that the Normal Hedge potential provides the tightest upper bounds on the cumulative regret of the top epsilon percentile.


FusionPainting Multimodal Fusion with Adaptive Attention for 3D Object Detection. Accurate detection of obstacles in 3D is an essential task for autonomous driving and intelligent transportation. In this work, we propose a general multimodal fusion framework FusionPainting to fuse the 2D RGB image and 3D point clouds at a semantic level for boosting the 3D object detection task. Especially, the FusionPainting framework consists of three main modules a multi modal semantic segmentation module, an adaptive attention based semantic fusion module, and a 3D object detector. First, semantic information is obtained for 2D images and 3D Lidar point clouds based on 2D and 3D segmentation approaches. Then the segmentation results from different sensors are adaptively fused based on the proposed attention based semantic fusion module. Finally, the point clouds painted with the fused semantic label are sent to the 3D detector for obtaining the 3D objection results. The effectiveness of the proposed framework has been verified on the large scale nuScenes detection benchmark by comparing it with three different baselines. The experimental results show that the fusion strategy can significantly improve the detection performance compared to the methods using only point clouds, and the methods using point clouds only painted with 2D segmentation information. Furthermore, the proposed approach outperforms other state of the art methods on the nuScenes testing benchmark.


Identifying Causal Influences on Publication Trends and Behavior A Case Study of the Computational Linguistics Community. Drawing causal conclusions from observational real world data is a very much desired but challenging task. In this paper we present mixed method analyses to investigate causal influences of publication trends and behavior on the adoption, persistence, and retirement of certain research foci methodologies, materials, and tasks that are of interest to the computational linguistics (CL) community. Our key findings highlight evidence of the transition to rapidly emerging methodologies in the research community (e.g., adoption of bidirectional LSTMs influencing the retirement of LSTMs), the persistent engagement with trending tasks and techniques (e.g., deep learning, embeddings, generative, and language models), the effect of scientist location from outside the US, e.g., China on propensity of researching languages beyond English, and the potential impact of funding for large scale research programs. We anticipate this work to provide useful insights about publication trends and behavior and raise the awareness about the potential for causal inference in the computational linguistics and a broader scientific community.


The popular assignment problem when cardinality is more important than popularity. We consider a matching problem in a bipartite graph G (A cup B,E) where each node in A is an agent having preferences in partial order over her neighbors, while nodes in B are objects with no preferences. The size of our matching is more important than node preferences thus, we are interested in maximum matchings only. Any pair of maximum matchings in G (equivalently, perfect matchings or assignments) can be compared by holding a head to head election between them where agents are voters. The goal is to compute an assignment M such that there is no better or "more popular" assignment. This is the popular assignment problem and it generalizes the well studied popular matching problem. Popular assignments need not always exist. We show a polynomial time algorithm that decides if the given instance admits one or not, and computes one, if so. In instances with no popular assignment, we consider the problem of finding an almost popular assignment, i.e., an assignment with minimum unpopularity margin. We show an O ( E k) time algorithm for deciding if there exists an assignment with unpopularity margin at most k . We show that this algorithm is essentially optimal by proving that the problem is mathsf W l 1 hard with parameter k . We also consider the minimum cost popular assignment problem when there are edge costs, and show its mathsf NP hardness even when all edge costs are in 0,1 and agents have strict preferences. By contrast, we propose a polynomial time algorithm to the problem of deciding if there exists a popular assignment with a given set of forced forbidden edges (this tractability holds even for partially ordered preferences). Our algorithms are combinatorial and based on LP duality. They search for an appropriate witness or dual certificate, and when a certificate cannot be found, we prove that the desired assignment does not exist in G .


Theoretical Guarantees for the Statistical Finite Element Method. The statistical finite element method (StatFEM) is an emerging probabilistic method that allows observations of a physical system to be synthesised with the numerical solution of a PDE intended to describe it in a coherent statistical framework, to compensate for model error. This work presents a new theoretical analysis of the statistical finite element method demonstrating that it has similar convergence properties to the finite element method on which it is based. Our results constitute a bound on the Wasserstein 2 distance between the ideal prior and posterior and the StatFEM approximation thereof, and show that this distance converges at the same mesh dependent rate as finite element solutions converge to the true solution. Several numerical examples are presented to demonstrate our theory, including an example which test the robustness of StatFEM when extended to nonlinear quantities of interest.


Avoiding Degeneracy for Monocular Visual SLAM with Point and Line Features. In this paper, a degeneracy avoidance method for a point and line based visual SLAM algorithm is proposed. Visual SLAM predominantly uses point features. However, point features lack robustness in low texture and illuminance variant environments. Therefore, line features are used to compensate the weaknesses of point features. In addition, point features are poor in representing discernable features for the naked eye, meaning mapped point features cannot be recognized. To overcome the limitations above, line features were actively employed in previous studies. However, since degeneracy arises in the process of using line features, this paper attempts to solve this problem. First, a simple method to identify degenerate lines is presented. In addition, a novel structural constraint is proposed to avoid the degeneracy problem. At last, a point and line based monocular SLAM system using a robust optical flow based lien tracking method is implemented. The results are verified using experiments with the EuRoC dataset and compared with other state of the art algorithms. It is proven that our method yields more accurate localization as well as mapping results.


O2D2 Out Of Distribution Detector to Capture Undecidable Trials in Authorship Verification. The PAN 2021 authorship verification (AV) challenge is part of a three year strategy, moving from a cross topic closed set AV task to a cross topic open set AV task over a collection of fanfiction texts. In this work, we present a novel hybrid neural probabilistic framework that is designed to tackle the challenges of the 2021 task. Our system is based on our 2020 winning submission, with updates to significantly reduce sensitivities to topical variations and to further improve the system's calibration by means of an uncertainty adaptation layer. Our framework additionally includes an out of distribution detector (O2D2) for defining non responses. Our proposed system outperformed all other systems that participated in the PAN 2021 AV task.


Knowledge Graph Question Answering via SPARQL Silhouette Generation. Knowledge Graph Question Answering (KGQA) has become a prominent area in natural language processing due to the emergence of large scale Knowledge Graphs (KGs). Recently Neural Machine Translation based approaches are gaining momentum that translates natural language queries to structured query languages thereby solving the KGQA task. However, most of these methods struggle with out of vocabulary words where test entities and relations are not seen during training time. In this work, we propose a modular two stage neural architecture to solve the KGQA task. The first stage generates a sketch of the target SPARQL called SPARQL silhouette for the input question. This comprises of (1) Noise simulator to facilitate out of vocabulary words and to reduce vocabulary size (2) seq2seq model for text to SPARQL silhouette generation. The second stage is a Neural Graph Search Module. SPARQL silhouette generated in the first stage is distilled in the second stage by substituting precise relation in the predicted structure. We simulate ideal and realistic scenarios by designing a noise simulator. Experimental results show that the quality of generated SPARQL silhouette in the first stage is outstanding for the ideal scenarios but for realistic scenarios (i.e. noisy linker), the quality of the resulting SPARQL silhouette drops drastically. However, our neural graph search module recovers it considerably. We show that our method can achieve reasonable performance improving the state of art by a margin of 3.72 F1 for the LC QuAD 1 dataset. We believe, our proposed approach is novel and will lead to dynamic KGQA solutions that are suited for practical applications.


Impact of a microfluidic jet onto a pendant droplet. High speed microfluidic jets can be generated by a thermocavitation process from the evaporation of the liquid inside a microfluidic channel, a rapidly expanding bubble is formed and generates a jet through a flow focusing effect. Here, we study the impact and traversing of such jets on a pendant liquid droplet. Upon impact, an expanding cavity is created, and, above a critical impact velocity, the jet traverses the entire droplet. We predict the critical traversing velocity (i) from a simple energy balance and (ii) by comparing the Young Laplace and dynamic pressures in the cavity that is created during impact. We contrast the model predictions against experiments, in which we vary the liquid properties of the pendant droplet and find good agreement. In addition, we asses how surfactants and viscoelastic effects influence the critical impact velocity. Our results are relevant for the study of needle free injections, where jets of similar velocities and dimensions are being used. Given the simplicity of our system we can systematically vary the target properties and unravel their effect on the impact dynamics, a true challenge when injecting into real skin.


Averaging of dispersion managed nonlinear Schr "odinger equations. We consider the dispersion managed power law nonlinear Schr "odinger(DM NLS) equations with a small parameter varepsilon 0 and the averaged equation, which are used in optical fiber communications. We prove that the solutions of DM NLS equations converge to the solution of the averaged equation in H 1( mathbb R ) as varepsilon goes to zero. Meanwhile, in the positive average dispersion, we obtain the global existence of the solution to DM NLS equation in H 1( mathbb R ) for sufficiently small varepsilon 0 , even when the exponent of the nonlinearity is beyond the mass critical power.


Automated Cleanup of the ImageNet Dataset by Model Consensus, Explainability and Confident Learning. The convolutional neural networks (CNNs) trained on ILSVRC12 ImageNet were the backbone of various applications as a generic classifier, a feature extractor or a base model for transfer learning. This paper describes automated heuristics based on model consensus, explainability and confident learning to correct labeling mistakes and remove ambiguous images from this dataset. After making these changes on the training and validation sets, the ImageNet Clean improves the model performance by 2 2.4 for SqueezeNet and EfficientNet B0 models. The results support the importance of larger image corpora and semi supervised learning, but the original datasets must be fixed to avoid transmitting their mistakes and biases to the student learner. Further contributions describe the training impacts of widescreen input resolutions in portrait and landscape orientations. The trained models and scripts are published on Github (https github.com kecsap imagenet clean) to clean up ImageNet and ImageNetV2 datasets for reproducible research.


A new framework for polynomial approximation to differential equations. In this paper we discuss a framework for the polynomial approximation to the solution of initial value problems for differential equations. The framework, initially devised for the approximation of ordinary differential equations, is further extended to cope with constant delay differential equations. Relevant classes of Runge Kutta methods can be derived within this framework.


Weak error estimate of a fully discrete method for stochastic Cahn Hilliard equation with additive noise. We prove a weak error estimate of a fully discrete scheme for stochastic Cahn Hilliard equation with additive noise, where the spectral Galerkin method is used in space and the backward Euler method is used in time. Compared with the Allen Cahn type stochastic partial differential equation, the error analysis here is much more sophisticated due to the presence of the unbounded operator in front of the nonlinear term. Besides, the weak analysis is also troublesome caused by the lack of the associated Kolmogorov equation. To address such issues, a novel and direct approach has been exploited which does not rely on a Kolmogorov equation but on the integration by parts formula from Malliavin calculus. To the best of our knowledge, the rates of weak convergence, shown to be higher than the strong convergence rates, are revealed in the stochastic Cahn Hilliard equation setting for the first time. Numerical examples are finally performed to confirm the theoretical results.


Learn from Human Teams a Probabilistic Solution to Real Time Collaborative Robot Handling with Dynamic Gesture Commands. We study real time collaborative robot (cobot) handling, where the cobot maneuvers a workpiece under human commands. This is useful when it is risky for humans to directly handle the workpiece. However, it is hard to make the cobot both easy to command and flexible in possible operations. In this work, we propose a Real Time Collaborative Robot Handling (RTCoHand) framework that allows the control of cobot via user customized dynamic gestures. This is hard due to variations among users, human motion uncertainties, and noisy human input. We model the task as a probabilistic generative process, referred to as Conditional Collaborative Handling Process (CCHP), and learn from human human collaboration. We thoroughly evaluate the adaptability and robustness of CCHP and apply our approach to a real time cobot handling task with Kinova Gen3 robot arm. We achieve seamless human robot collaboration with both experienced and new users. Compared to classical controllers, RTCoHand allows significantly more complex maneuvers and lower user cognitive burden. It also eliminates the need for trial and error, rendering it advantageous in safety critical tasks.


Searching for TrioNet Combining Convolution with Local and Global Self Attention. Recently, self attention operators have shown superior performance as a stand alone building block for vision models. However, existing self attention models are often hand designed, modified from CNNs, and obtained by stacking one operator only. A wider range of architecture space which combines different self attention operators and convolution is rarely explored. In this paper, we explore this novel architecture space with weight sharing Neural Architecture Search (NAS) algorithms. The result architecture is named TrioNet for combining convolution, local self attention, and global (axial) self attention operators. In order to effectively search in this huge architecture space, we propose Hierarchical Sampling for better training of the supernet. In addition, we propose a novel weight sharing strategy, Multi head Sharing, specifically for multi head self attention operators. Our searched TrioNet that combines self attention and convolution outperforms all stand alone models with fewer FLOPs on ImageNet classification where self attention performs better than convolution. Furthermore, on various small datasets, we observe inferior performance for self attention models, but our TrioNet is still able to match the best operator, convolution in this case. Our code is available at https github.com phj128 TrioNet.


Integrating Visuospatial, Linguistic and Commonsense Structure into Story Visualization. While much research has been done in text to image synthesis, little work has been done to explore the usage of linguistic structure of the input text. Such information is even more important for story visualization since its inputs have an explicit narrative structure that needs to be translated into an image sequence (or visual story). Prior work in this domain has shown that there is ample room for improvement in the generated image sequence in terms of visual quality, consistency and relevance. In this paper, we first explore the use of constituency parse trees using a Transformer based recurrent architecture for encoding structured input. Second, we augment the structured input with commonsense information and study the impact of this external knowledge on the generation of visual story. Third, we also incorporate visual structure via bounding boxes and dense captioning to provide feedback about the characters objects in generated images within a dual learning setup. We show that off the shelf dense captioning models trained on Visual Genome can improve the spatial structure of images from a different target domain without needing fine tuning. We train the model end to end using intra story contrastive loss (between words and image sub regions) and show significant improvements in several metrics (and human evaluation) for multiple datasets. Finally, we provide an analysis of the linguistic and visuo spatial information. Code and data https github.com adymaharana VLCStoryGan.


Adaptive Configuration of In Situ Lossy Compression for Cosmology Simulations via Fine Grained Rate Quality Modeling. Extreme scale cosmological simulations have been widely used by today's researchers and scientists on leadership supercomputers. A new generation of error bounded lossy compressors has been used in workflows to reduce storage requirements and minimize the impact of throughput limitations while saving large snapshots of high fidelity data for post hoc analysis. In this paper, we propose to adaptively provide compression configurations to compute partitions of cosmological simulations with newly designed post analysis aware rate quality modeling. The contribution is fourfold (1) We propose a novel adaptive approach to select feasible error bounds for different partitions, showing the possibility and efficiency of adaptively configuring lossy compression for each partition individually. (2) We build models to estimate the overall loss of post analysis result due to lossy compression and to estimate compression ratio, based on the property of each partition. (3) We develop an efficient optimization guideline to determine the best fit configuration of error bounds combination in order to maximize the compression ratio under acceptable post analysis quality loss. (4) Our approach introduces negligible overheads for feature extraction and error bound optimization for each partition, enabling post analysis aware in situ lossy compression for cosmological simulations. Experiments show that our proposed models are highly accurate and reliable. Our fine grained adaptive configuration approach improves the compression ratio of up to 73 on the tested datasets with the same post analysis distortion with only 1 performance overhead.


Quantitative stochastic homogenization of nonlinearly elastic, random laminates. In this paper we study quantitative stochastic homogenization of a nonlinearly elastic composite material with a laminate microstructure. We prove that for deformations close to the set of rotations the homogenized stored energy function W rm hom is C 3 and that W rm hom , the stress tensor DW rm hom , and the tangent moduli D 2W rm hom can be represented with help of stochastic correctors. Furthermore, we study the error of an approximation of these quantities via representative volume elements. More precisely, we consider periodic RVEs obtained by periodizing the distribution of the random material. For materials with a fast decay of correlations on scales larger than a unit scale, we establish error estimates on the random and systematic error of the RVE with optimal scaling in the size of the RVE and with a multiplicative random constant that has exponential moments.


Classifying Video based on Automatic Content Detection Overview. Video classification and analysis is always a popular and challenging field in computer vision. It is more than just simple image classification due to the correlation with respect to the semantic contents of subsequent frames brings difficulties for video analysis. In this literature review, we summarized some state of the art methods for multi label video classification. Our goal is first to experimentally research the current widely used architectures, and then to develop a method to deal with the sequential data of frames and perform multi label classification based on automatic content detection of video.


Betti Curves of Rank One Symmetric Matrices. Betti curves of symmetric matrices were introduced in (Giusti et. al., 2015) as a new class of matrix invariants that depend only on the relative ordering of matrix entries. These invariants are computed using persistent homology, and can be used to detect underlying structure in biological data that may otherwise be obscured by monotone nonlinearities. Here we prove three theorems that fully characterize the Betti curves of rank 1 symmetric matrices. We then illustrate how these Betti curve signatures arise in natural data obtained from calcium imaging of neural activity in zebrafish.


MTCD Cataract Detection via Near Infrared Eye Images. Globally, cataract is a common eye disease and one of the leading causes of blindness and vision impairment. The traditional process of detecting cataracts involves eye examination using a slit lamp microscope or ophthalmoscope by an ophthalmologist, who checks for clouding of the normally clear lens of the eye. The lack of resources and unavailability of a sufficient number of experts pose a burden to the healthcare system throughout the world, and researchers are exploring the use of AI solutions for assisting the experts. Inspired by the progress in iris recognition, in this research, we present a novel algorithm for cataract detection using near infrared eye images. The NIR cameras, which are popularly used in iris recognition, are of relatively low cost and easy to operate compared to ophthalmoscope setup for data capture. However, such NIR images have not been explored for cataract detection. We present deep learning based eye segmentation and multitask network classification networks for cataract detection using NIR images as input. The proposed segmentation algorithm efficiently and effectively detects non ideal eye boundaries and is cost effective, and the classification network yields very high classification performance on the cataract dataset.


Let Trajectories Speak Out the Traffic Bottlenecks. Traffic bottlenecks are a set of road segments that have an unacceptable level of traffic caused by a poor balance between road capacity and traffic volume. A huge volume of trajectory data which captures real time traffic conditions in road networks provides promising new opportunities to identify the traffic bottlenecks. In this paper, we define this problem as trajectory driven traffic bottleneck identification Given a road network R, a trajectory database T , find a representative set of seed edges of size K of traffic bottlenecks that influence the highest number of road segments not in the seed set. We show that this problem is NP hard and propose a framework to find the traffic bottlenecks as follows. First, a traffic spread model is defined which represents changes in traffic volume for each road segment over time. Then, the traffic diffusion probability between two connected segments and the residual ratio of traffic volume for each segment can be computed using historical trajectory data. We then propose two different algorithmic approaches to solve the problem. The first one is a best first algorithm BF, with an approximation ratio of 1 1 e. To further accelerate the identification process in larger datasets, we also propose a sampling based greedy algorithm SG. Finally, comprehensive experiments using three different datasets compare and contrast various solutions, and provide insights into important efficiency and effectiveness trade offs among the respective methods.


Openslice An opensource OSS for Delivering Network Slice as a Service. As the 5G standards mature and awareness of the capabilities of the technology increases, industry verticals are becoming more eager to test new services and develop them to the level of maturity required for market adoption. Network slicing, i.e. multiple virtual networks running on a common infrastructure, is considered a key mechanism to serve the multitude of tenants (e.g. vertical industries) targeted by forthcoming fifth generation (5G) systems, in a flexible and cost efficient manner. It is predicted that one of the most popular models for customers will be the Network Slice as a Service (NSaaS) model. This model allows a Network Service Customer to order and configure a Network Slice and offered it as a service. This work presents Openlice a Service based, opens ource OSS for delivering NSaaS following emerging standards from SDOs. We strongly believe that such open source solutions make it easier for organizations to enable complex scenarios especially in the are of Non Public Networks.


Efficient Click Through Rate Prediction for Developing Countries via Tabular Learning. Despite the rapid growth of online advertisement in developing countries, existing highly over parameterized Click Through Rate (CTR) prediction models are difficult to be deployed due to the limited computing resources. In this paper, by bridging the relationship between CTR prediction task and tabular learning, we present that tabular learning models are more efficient and effective in CTR prediction than over parameterized CTR prediction models. Extensive experiments on eight public CTR prediction datasets show that tabular learning models outperform twelve state of the art CTR prediction models. Furthermore, compared to over parameterized CTR prediction models, tabular learning models can be fast trained without expensive computing resources including high performance GPUs. Finally, through an A B test on an actual online application, we show that tabular learning models improve not only offline performance but also the CTR of real users.


Few shot Neural Human Performance Rendering from Sparse RGBD Videos. Recent neural rendering approaches for human activities achieve remarkable view synthesis results, but still rely on dense input views or dense training with all the capture frames, leading to deployment difficulty and inefficient training overload. However, existing advances will be ill posed if the input is both spatially and temporally sparse. To fill this gap, in this paper we propose a few shot neural human rendering approach (FNHR) from only sparse RGBD inputs, which exploits the temporal and spatial redundancy to generate photo realistic free view output of human activities. Our FNHR is trained only on the key frames which expand the motion manifold in the input sequences. We introduce a two branch neural blending to combine the neural point render and classical graphics texturing pipeline, which integrates reliable observations over sparse key frames. Furthermore, we adopt a patch based adversarial training process to make use of the local redundancy and avoids over fitting to the key frames, which generates fine detailed rendering results. Extensive experiments demonstrate the effectiveness of our approach to generate high quality free view point results for challenging human performances under the sparse setting.


Machine Learned Molecular Surface and Its Application to Implicit Solvent Simulation. Implicit solvent models, such as Poisson Boltzmann models, play important roles in computational studies of biomolecules. A vital step in almost all implicit solvent models is to determine the solvent solute interface, and the solvent excluded surface (SES) is the most widely used interface definition in these models. However, classical algorithms used for computing SES are geometry based, thus neither suitable for parallel implementations nor convenient for obtaining surface derivatives. To address the limitations, we explored a machine learning strategy to obtain a level set formulation for the SES. The training process was conducted in three steps, eventually leading to a model with over 95 agreement with the classical SES. Visualization of tested molecular surfaces shows that the machine learned SES overlaps with the classical SES on almost all situations. We also implemented the machine learned SES into the Amber PBSA program to study its performance on reaction field energy calculation. The analysis shows that the two sets of reaction field energies are highly consistent with 1 deviation on average. Given its level set formulation, we expect the machine learned SES to be applied in molecular simulations that require either surface derivatives or high efficiency on parallel computing platforms.


Scalable Microservice Forensics and Stability Assessment Using Variational Autoencoders. We present a deep learning based approach to containerized application runtime stability analysis, and an intelligent publishing algorithm that can dynamically adjust the depth of process level forensics published to a backend incident analysis repository. The approach applies variational autoencoders (VAEs) to learn the stable runtime patterns of container images, and then instantiates these container specific VAEs to implement stability detection and adaptive forensics publishing. In performance comparisons using a 50 instance container workload, a VAE optimized service versus a conventional eBPF based forensic publisher demonstrates 2 orders of magnitude (OM) CPU performance improvement, a 3 OM reduction in network transport volume, and a 4 OM reduction in Elasticsearch storage costs. We evaluate the VAE based stability detection technique against two attacks, CPUMiner and HTTP flood attack, finding that it is effective in isolating both anomalies. We believe this technique provides a novel approach to integrating fine grained process monitoring and digital forensic services into large container ecosystems that today simply cannot be monitored by conventional techniques


Offline Online Reinforcement Learning for Energy Pricing in Office Demand Response Lowering Energy and Data Costs. Our team is proposing to run a full scale energy demand response experiment in an office building. Although this is an exciting endeavor which will provide value to the community, collecting training data for the reinforcement learning agent is costly and will be limited. In this work, we examine how offline training can be leveraged to minimize data costs (accelerate convergence) and program implementation costs. We present two approaches to doing so pretraining our model to warm start the experiment with simulated tasks, and using a planning model trained to simulate the real world's rewards to the agent. We present results that demonstrate the utility of offline reinforcement learning to efficient price setting in the energy demand response problem.


Connection Management xAPP for O RAN RIC A Graph Neural Network and Reinforcement Learning Approach. Connection management is an important problem for any wireless network to ensure smooth and well balanced operation throughout. Traditional methods for connection management (specifically user cell association) consider sub optimal and greedy solutions such as connection of each user to a cell with maximum receive power. However, network performance can be improved by leveraging machine learning (ML) and artificial intelligence (AI) based solutions. The next generation software defined 5G networks defined by the Open Radio Access Network (O RAN) alliance facilitates the inclusion of ML AI based solutions for various network problems. In this paper, we consider intelligent connection management based on the O RAN network architecture to optimize user association and load balancing in the network. We formulate connection management as a combinatorial graph optimization problem. We propose a deep reinforcement learning (DRL) solution that uses the underlying graph to learn the weights of the graph neural networks (GNN) for optimal user cell association. We consider three candidate objective functions sum user throughput, cell coverage, and load balancing. Our results show up to 10 gain in throughput, 45 140 gain cell coverage, 20 45 gain in load balancing depending on network deployment configurations compared to baseline greedy techniques.


Almost exponential decay for subcritical Constrained degree percolation. We consider the Constrained degree percolation model in random environment (CDPRE) on the square lattice. In this model, each vertex v has an independent random constraint kappa v which takes the value j in 0,1,2,3 with probability rho j . The dynamics is as follows each edge e attempts to open at a random time U e sim mathrm U (0,1 , independently of all other edges. It succeeds if at time U e both its end vertices have degrees strictly smaller than their respective constraints. We obtain almost exponential decay of the radius of the open cluster of the origin at all times when its expected size is finite. Since CDPRE is dominated by Bernoulli percolation, such result is meaningful only if the supremum of all values of t for which the expected size of the open cluster of the origin is finite is larger than 1 2. We prove this last fact by showing a sharp phase transition for an intermediate model.


Proof of the elliptic expansion Moonshine Conjecture of C u a ld u a raru, He, and Huang. Using predictions in mirror symmetry, C u a ld u a raru, He, and Huang recently formulated a "Moonshine Conjecture at Landau Ginzburg points" for Klein's modular j function at j 0 and j 1728. The conjecture asserts that the j function, when specialized at specific flat coordinates on the moduli spaces of versal deformations of the corresponding CM elliptic curves, yields simple rational functions. We prove this conjecture, and show that these rational functions arise from classical 2F 1 hypergeometric inversion formulae for the j function.


Metamorphic Detection of Repackaged Malware. Machine learning based malware detection systems are often vulnerable to evasion attacks, in which a malware developer manipulates their malicious software such that it is misclassified as benign. Such software hides some properties of the real class or adopts some properties of a different class by applying small perturbations. A special case of evasive malware hides by repackaging a bonafide benign mobile app to contain malware in addition to the original functionality of the app, thus retaining most of the benign properties of the original app. We present a novel malware detection system based on metamorphic testing principles that can detect such benign seeming malware apps. We apply metamorphic testing to the feature representation of the mobile app rather than to the app itself. That is, the source input is the original feature vector for the app and the derived input is that vector with selected features removed. If the app was originally classified benign and is indeed benign, the output for the source and derived inputs should be the same class, i.e., benign, but if they differ, then the app is exposed as likely malware. Malware apps originally classified as malware should retain that classification since only features prevalent in benign apps are removed. This approach enables the machine learning model to classify repackaged malware with reasonably few false negatives and false positives. Our training pipeline is simpler than many existing ML based malware detection methods, as the network is trained end to end to learn appropriate features and perform classification. We pre trained our classifier model on 3 million apps collected from the widely used AndroZoo dataset. We perform an extensive study on other publicly available datasets to show our approach's effectiveness in detecting repackaged malware with more than94 accuracy, 0.98 precision, 0.95 recall, and 0.96 F1 score.


A Dimension Reduction Technique for Large scale Structured Sparse Optimization Problems with Application to Convex Clustering. In this paper, we propose a novel adaptive sieving (AS) technique and an enhanced AS (EAS) technique, which are solver independent and could accelerate optimization algorithms for solving large scale convex optimization problems with intrinsic structured sparsity. We establish the finite convergence property of the AS technique and the EAS technique with inexact solutions of the reduced subproblems. As an important application, we apply the AS technique and the EAS technique on the convex clustering model, which could accelerate the state of the art algorithm SSNAL by more than 7 times and the algorithm ADMM by more than 14 times.


New subclass of the class of close to convex harmonic mappings defined by a third order differential inequality. In this paper, we introduce a new subclass of harmonic functions f s overline t in the open unit disk U left z in C left vert z right vert 1 right satisfying text Re left gamma s prime (z) delta zs prime prime (z) left( frac delta gamma 2 right) z 2 s prime prime prime left( z right) lambda right left vert gamma t prime (z) delta zt prime prime (z) left( frac delta gamma 2 right) z 2 t prime prime prime left( z right) right vert, where 0 leq lambda gamma leq delta, z in U. We determine several properties of this class such as close to convexity, coefficient bounds, and growth estimates. We also prove that this class is closed under convex combination and convolution of its members. Furthermore, we investigate the properties of fully starlikeness and fully convexity of the class.


The analytic dually flat space of the mixture family of two prescribed distinct Cauchy distributions. A smooth and strictly convex function on an open convex domain induces both (1) a Hessian manifold with respect to the standard flat Euclidean connection, and (2) a dually flat space of information geometry. We first review these constructions and illustrate how to instantiate them for (a) full regular exponential families from their partition functions, (b) regular homogeneous cones from their characteristic functions, and (c) mixture families from their Shannon negentropy functions. Although these structures can be explicitly built for many common examples of the first two classes, the differential entropy of a continuous statistical mixture with distinct prescribed density components sharing the same support is hitherto not known in closed form, hence forcing implementations of mixture family manifolds in practice using Monte Carlo sampling. In this work, we report a notable exception The family of mixtures defined as the convex combination of two prescribed and distinct Cauchy distributions. As a byproduct, we report closed form formula for the Jensen Shannon divergence between two mixtures of two prescribed Cauchy components.


Khmer Word Search Challenges, Solutions, and Semantic Aware Search. Search is one of the key functionalities in digital platforms and applications such as an electronic dictionary, a search engine, and an e commerce platform. While the search function in some languages is trivial, Khmer word search is challenging given its complex writing system. Multiple orders of characters and different spelling realizations of words impose a constraint on Khmer word search functionality. Additionally, spelling mistakes are common since robust spellcheckers are not commonly available across the input device platforms. These challenges hinder the use of Khmer language in search embedded applications. Moreover, due to the absence of WordNet like lexical databases for Khmer language, it is impossible to establish semantic relation between words, enabling semantic search. In this paper, we propose a set of robust solutions to the above challenges associated with Khmer word search. The proposed solutions include character order normalization, grapheme and phoneme based spellcheckers, and Khmer word semantic model. The semantic model is based on the word embedding model that is trained on a 30 million word corpus and is used to capture the semantic similarities between words.


A Single Target License Plate Detection with Attention. With the development of deep learning, Neural Network is commonly adopted to the License Plate Detection (LPD) task and achieves much better performance and precision, especially CNN based networks can achieve state of the art RetinaNet 1 . For a single object detection task such as LPD, modified general object detection would be time consuming, unable to cope with complex scenarios and a cumbersome weights file that is too hard to deploy on the embedded device.


Generalising a conjecture due to Bollobas and Nikiforov. Let mu 1 ge ldots ge mu n denote the eigenvalues of a graph G with m edges and clique number omega(G) . Nikiforov proved a spectral version of Tur 'an's theorem that mu 1 2 le frac 2m( omega 1) omega , and Bollob 'as and Nikiforov conjectured that for G not K n mu 1 2 mu 2 2 le frac 2m( omega 1) omega . This paper proposes the conjecture that for all graphs ( mu 1 2 mu 2 2) in this inequality can be replaced by the sum of the squares of the omega largest eigenvalues, provided they are positive. We prove the conjecture for weakly perfect, Kneser, Johnson and classes of strongly regular graphs. We also provide experimental evidence and describe how the bound can be applied.


New Construction of Z Complementary Code Sets and Mutually Orthogonal Complementary Sequence Sets. Due to the zero nontrivial aperiodic correlation of complete complementary code (CCCs), it is used in asynchronous multi carrier code division multiple access (MC CDMA) communication to provide zero interference performance. However, there is no CCC for some lengths. In this case, if the system pays more attention to the correlation, it can use mutually orthogonal complementary sequence sets (MOCSSs), and if the system pays more attention to the set size, it can use Z complementary code sets (ZCCSs). In this paper, we propose a direct construction of q ary (q v 1 ,q,q m,q m v ) ZCCS. In addition, based on the known CCCs, we propose a new construction of MOCSSs and CCCs respectively.


On a Class of Fully Nonlinear Curvature Flows in Hyperbolic Space. In this paper, we study a class of flows of closed, star shaped hypersurfaces in hyperbolic space mathbb H n 1 with speed ( sinh r) alpha beta sigma k 1 beta , where sigma k is the k th elementary symmetric polynomial of the principal curvatures, alpha , beta are positive constants and r is the distance from points on the hypersurface to the origin. We obtain convergence results under some assumptions of k , alpha and beta . When k 1 , alpha 1 beta , and the initial hypersurface is mean convex, we prove that the mean convex solution to the flow for k 1 exists for all time and converges smoothly to a sphere. When 1 leq k leq n, alpha k beta , and the initial hypersurface is uniformly convex, we prove that the uniformly convex solution to the flow exists for all time and converges smoothly to a sphere. In particular, we generalize Li Sheng Wang's results from Euclidean space to hyperbolic space.


Towards a Real Time Facial Analysis System. Facial analysis is an active research area in computer vision, with many practical applications. Most of the existing studies focus on addressing one specific task and maximizing its performance. For a complete facial analysis system, one needs to solve these tasks efficiently to ensure a smooth experience. In this work, we present a system level design of a real time facial analysis system. With a collection of deep neural networks for object detection, classification, and regression, the system recognizes age, gender, facial expression, and facial similarity for each person that appears in the camera view. We investigate the parallelization and interplay of individual tasks. Results on common off the shelf architecture show that the system's accuracy is comparable to the state of the art methods, and the recognition speed satisfies real time requirements. Moreover, we propose a multitask network for jointly predicting the first three attributes, i.e., age, gender, and facial expression. Source code and trained models are available at https github.com mahehu TUT live age estimator.


Protograph based Bit Interleaved Coded Modulation A Promising Bandwidth Efficient Design Paradigm. As an established bandwidth efficient coded modulation technique, bit interleaved coded modulation (BICM) can achieve very desirable error performance with relatively low implementation complexity for a large number of communication and storage systems. It attracted considerable attention from the research community in the past three decades. The BICM is able to approach Shannon capacity limits over various channels with the use of powerful forward error correction (FEC) codes, bit mappers (i.e., interleavers), and high order modulations. Based on the natural serially concatenated structure of BICM, iterative demapping and decoding (ID) can be adopted to boost the system performance. Due to the tremendous error correction capability and simple structures, protograph low density parity check (PLDPC) codes and their spatially coupled (SC) variants have emerged to be a pragmatic and promising FEC solution for BICM systems, and found widespread applications such as deep space communication, satellite communication, wireless communication, optical communication, and flash memory based data storage in recent years. This article offers a comprehensive survey on the state of the art development of PLDPC coded BICM and its innovative SC variants over a variety of channel models, e.g., additive white Gaussian noise (AWGN) channels, fading channels, Poisson pulse position modulation (PPM) channels, and NAND flash memory channels. Of particular interest is code construction, constellation shaping, as well as bit mapper design, where the receiver is formulated as a serially concatenated decoding framework consisting of a soft decision demapper and a belief propagation decoder. In addition, several promising research directions are discussed, which have not been adequately addressed in the current literature.


Performance Analysis and Improvement of Parallel Differential Evolution. Differential evolution (DE) is an effective global evolutionary optimization algorithm using to solve global optimization problems mainly in a continuous domain. In this field, researchers pay more attention to improving the capability of DE to find better global solutions, however, the computational performance of DE is also a very interesting aspect especially when the problem scale is quite large. Firstly, this paper analyzes the design of parallel computation of DE which can easily be executed in Math Kernel Library (MKL) and Compute Unified Device Architecture (CUDA). Then the essence of the exponential crossover operator is described and we point out that it cannot be used for better parallel computation. Later, we propose a new exponential crossover operator (NEC) that can be executed parallelly with MKL CUDA. Next, the extended experiments show that the new crossover operator can speed up DE greatly. In the end, we test the new parallel DE structure, illustrating that the former is much faster.


Quasitriangular Hopf algebras of dimension pq 2. Let p and q be distinct odd primes and assume k is an algebraically closed field of characteristic zero. We classify all quasitriangular Hopf algebras of dimension pq 2 over k, which are not simple as Hopf algebras. Moreover, we obtained all quasitriangular structures on these Hopf algebras.


Time Complexity Analysis of Randomized Search Heuristics for the Dynamic Graph Coloring Problem. We contribute to the theoretical understanding of randomized search heuristics for dynamic problems. We consider the classical vertex coloring problem on graphs and investigate the dynamic setting where edges are added to the current graph. We then analyze the expected time for randomized search heuristics to recompute high quality solutions. The (1 1) Evolutionary Algorithm and RLS operate in a setting where the number of colors is bounded and we are minimizing the number of conflicts. Iterated local search algorithms use an unbounded color palette and aim to use the smallest colors and, consequently, the smallest number of colors. We identify classes of bipartite graphs where reoptimization is as hard as or even harder than optimization from scratch, i.e., starting with a random initialization. Even adding a single edge can lead to hard symmetry problems. However, graph classes that are hard for one algorithm turn out to be easy for others. In most cases our bounds show that reoptimization is faster than optimizing from scratch. We further show that tailoring mutation operators to parts of the graph where changes have occurred can significantly reduce the expected reoptimization time. In most settings the expected reoptimization time for such tailored algorithms is linear in the number of added edges. However, tailored algorithms cannot prevent exponential times in settings where the original algorithm is inefficient.


Internet of Everything Driven Neuromarketing Key Technologies and Challenges. Preserving customers' expectations and understanding factors affecting their purchasing decisions would significantly affect designing effective marketing and advertising strategies. However, constantly and swiftly changing the customers' interests and consumption behaviors, make it inevitable to utilize the sophisticated tools and approaches based on advanced technologies. Among them, neuromarketing by measuring the customers' physiological and neural signals, studying the consumers' cognitive, and affective responses to marketing stimulus, provides deep insight into the customers' motivations, preferences, and decisions. Recently, the Internet of Everything (IoE) has brought many new opportunities to the industry and has attracted the attention of many researchers in recent years. The main objective of this paper is to address how the Internet of Everything (IoE) would empower neuromarketing techniques. In particular, applications of IoE gadgets and devices in eleven groups of neuromarketing techniques are discussed to present numerous solutions that would help meet this goal. Moreover, we present an in depth understanding of current research issues as well as emerging trends.


Gamma matrices a new class of simultaneously diagonalizable matrices. In order to precondition Toeplitz systems, we present a new class of simultaneously diagonalizable real matrices, the Gamma matrices, which include both symmetric circulant matrices and a subclass of the set of all reverse circulant matrices. We define some algorithms for fast computation of the product between a Gamma matrix and a real vector and between two Gamma matrices. Moreover, we illustrate a technique of approximating a real symmetric Toeplitz matrix by a Gamma matrix, and we show that the eigenvalues of the preconditioned matrix are clustered around zero with the exception of at most a finite number of terms.


Quantitative predictions of neoadjuvant chemotherapy effects in breast cancer by individual patient data assimililation. Neoadjuvant chemotherapy has been used for breast cancer aiming at downgrading before surgery. In this article we propose a new quantitative analysis of the effects of the neoadjuvant therapy to obtain numerical, personalized, predictions on the shrinkage of the tumor size after the drug doses, by data assimilation of the individual patient. The algorithm has been validated by a sample of 37 patients with histological diagnosis of locally advanced primary breast carcinoma. The biopsy specimen, the initial tumor size and its reduction after each treatment were known for all patients. We find that a) the measure of tumor size at the diagnosis and after the first dose permits to predict the size reduction for the follow up b) the results are in agreement with our data sample, within 10 20 , for about 90 of the patients. The quantitative indications suggest the best time for surgery. The analysis is patient oriented, weakly model dependent and can be applied to other cancer phenotypes.


Stochastic Mirror Descent Convergence Analysis and Adaptive Variants via the Mirror Stochastic Polyak Stepsize. We investigate the convergence of stochastic mirror descent (SMD) in relatively smooth and smooth convex optimization. In relatively smooth convex optimization we provide new convergence guarantees for SMD with a constant stepsize. For smooth convex optimization we propose a new adaptive stepsize scheme the mirror stochastic Polyak stepsize (mSPS). Notably, our convergence results in both settings do not make bounded gradient assumptions or bounded variance assumptions, and we show convergence to a neighborhood that vanishes under interpolation. mSPS generalizes the recently proposed stochastic Polyak stepsize (SPS) (Loizou et al., 2021) to mirror descent and remains both practical and efficient for modern machine learning applications while inheriting the benefits of mirror descent. We complement our results with experiments across various supervised learning tasks and different instances of SMD, demonstrating the effectiveness of mSPS.


Replay in Deep Learning Current Approaches and Missing Biological Elements. Replay is the reactivation of one or more neural patterns, which are similar to the activation patterns experienced during past waking experiences. Replay was first observed in biological neural networks during sleep, and it is now thought to play a critical role in memory formation, retrieval, and consolidation. Replay like mechanisms have been incorporated into deep artificial neural networks that learn over time to avoid catastrophic forgetting of previous knowledge. Replay algorithms have been successfully used in a wide range of deep learning methods within supervised, unsupervised, and reinforcement learning paradigms. In this paper, we provide the first comprehensive comparison between replay in the mammalian brain and replay in artificial neural networks. We identify multiple aspects of biological replay that are missing in deep learning systems and hypothesize how they could be utilized to improve artificial neural networks.


Environmental Impacts of Personal Protective Clothing Used to Combat COVID 19. Personal protective clothing is critical to shield users from highly infectious diseases including COVID 19. Such clothing is predominantly single use, made of plastic based synthetic fibres such as polypropylene and polyester, low cost and able to provide protection against pathogens. However, the environmental impacts of synthetic fibre based clothing are significant and well documented. Despite growing environmental concerns with single use plastic based protective clothing, the recent COVID 19 pandemic has seen a significant increase in their use, that could result in a further surge of oceanic plastic pollution, adding to mass of plastic waste that already threatens marine life. In this review, we briefly discuss the nature of the raw materials involved in the production of such clothing, as well as manufacturing techniques and the PPE supply chain. We identify the environmental impacts at critical points in the protective clothing value chain from production to consumption, focusing on water use, chemical pollution, CO2 emissions and waste. On the basis of these environmental impacts, we outline the need for fundamental changes in the business model, including increased usage of reusable protective clothing, addressing supply chain bottlenecks, establishing better waste management, and the use of sustainable materials and processes without associated environmental problems.


Necessary Density Conditions for Sampling and Interpolation in Spectral Subspaces of Elliptic Differential Operators. We prove necessary density conditions for sampling in spectral subspaces of a second order uniformly elliptic differential operator on R d with slowly oscillating symbol. For constant coefficient operators, these are precisely Landaus necessary density conditions for bandlimited functions, but for more general elliptic differential operators it has been unknown whether such a critical density even exists. Our results prove the existence of a suitable critical sampling density and compute it in terms of the geometry defined by the elliptic operator. In dimension 1, functions in a spectral subspace can be interpreted as functions with variable bandwidth, and we obtain a new critical density for variable bandwidth. The methods are a combination of the spectral theory and the regularity theory of elliptic partial differential operators, some elements of limit operators, certain compactifications of R d , and the theory of reproducing kernel Hilbert spaces.


Underwater metamaterial absorber with impedance matched composite. By using a structured tungsten polyurethane composite that is impedance matched to water while simultaneously having a much slower longitudinal sound speed, we have theoretically designed, and experimentally realized, an underwater acoustic absorber exhibiting high absorption from 4 to 20 kHz, measured in a 5.6m times 3.6m water pool with the time domain approach. The broadband functionality is achieved by optimally engineering the distribution of the Fabry Perot resonances, based on an integration scheme, to attain impedance matching over a broad frequency range. The average thickness of the integrated absorber, 8.9 mm, is in the deep subwavelength regime ( lambda 42 at 4 kHz) and close to the causal minimum thickness of 8.2 mm that is evaluated from the simulated absorption spectrum. The structured composite represents a new type of acoustic metamaterials that has high acoustic energy density and promises broad underwater applications.


Scaling Scaling Laws with Board Games. The largest experiments in machine learning now require resources far beyond the budget of all but a few institutions. Fortunately, it has recently been shown that the results of these huge experiments can often be extrapolated from the results of a sequence of far smaller, cheaper experiments. In this work, we show that not only can the extrapolation be done based on the size of the model, but on the size of the problem as well. By conducting a sequence of experiments using AlphaZero and Hex, we show that the performance achievable with a fixed amount of compute degrades predictably as the game gets larger and harder. Along with our main result, we further show that the test time and train time compute available to an agent can be traded off while maintaining performance.


On the Farrell Jones conjecture for localising invariants. We show the Farrell Jones conjecture with coefficients in left exact infty categories for finitely mathcal F amenable groups and, more generally, Dress Farrell Hsiang Jones groups. Our result subsumes and unifies arguments for the K theory of additive categories and spherical group rings and extends it for example to categories of perfect modules over mathbb E 1 ring spectra.


iPOKE Poking a Still Image for Controlled Stochastic Video Synthesis. How would a static scene react to a local poke? What are the effects on other parts of an object if you could locally push it? There will be distinctive movement, despite evident variations caused by the stochastic nature of our world. These outcomes are governed by the characteristic kinematics of objects that dictate their overall motion caused by a local interaction. Conversely, the movement of an object provides crucial information about its underlying distinctive kinematics and the interdependencies between its parts. This two way relation motivates learning a bijective mapping between object kinematics and plausible future image sequences. Therefore, we propose iPOKE invertible Prediction of Object Kinematics that, conditioned on an initial frame and a local poke, allows to sample object kinematics and establishes a one to one correspondence to the corresponding plausible videos, thereby providing a controlled stochastic video synthesis. In contrast to previous works, we do not generate arbitrary realistic videos, but provide efficient control of movements, while still capturing the stochastic nature of our environment and the diversity of plausible outcomes it entails. Moreover, our approach can transfer kinematics onto novel object instances and is not confined to particular object classes. Our project page is available at https bit.ly 3dJN4Lf.


Viscous effects on plasmoid formation from nonlinear resistive tearing growth in a Harris sheet. In this study, the evolution of a highly unstable m 1 resistive tearing mode, leading to plasmoid formation in a Harris sheet is studied in the framework of full MHD model using the NIMROD simulation. Following the initial nonlinear growth of the primary m 1 island, the X point develops into a secondary elongated current sheet that eventually breaks into plasmoids. Two distinctive viscous regimes are found for the plasmoid formation and saturation. In the low viscosity regime (i.e. P r . 1), the plasmoid width increases sharply with viscosity, whereas in the viscosity dominant regime (i.e. P r 1 ), the plasmoid size gradually decreases with viscosity. Such a finding quantifies the role of viscosity in modulating the plasmoid formation process through its effects on the plasma flow and the reconnection itself.


Controlled Deep Reinforcement Learning for Optimized Slice Placement. We present a hybrid ML heuristic approach that we name "Heuristically Assisted Deep Reinforcement Learning (HA DRL)" to solve the problem of Network Slice Placement Optimization. The proposed approach leverages recent works on Deep Reinforcement Learning (DRL) for slice placement and Virtual Network Embedding (VNE) and uses a heuristic function to optimize the exploration of the action space by giving priority to reliable actions indicated by an efficient heuristic algorithm. The evaluation results show that the proposed HA DRL algorithm can accelerate the learning of an efficient slice placement policy improving slice acceptance ratio when compared with state of the art approaches that are based only on reinforcement learning.


Weight Initialization Techniques for Deep Learning Algorithms in Remote Sensing Recent Trends and Future Perspectives. During the last decade, several research works have focused on providing novel deep learning methods in many application fields. However, few of them have investigated the weight initialization process for deep learning, although its importance is revealed in improving deep learning performance. This can be justified by the technical difficulties in proposing new techniques for this promising research field. In this paper, a survey related to weight initialization techniques for deep algorithms in remote sensing is conducted. This survey will help practitioners to drive further research in this promising field. To the best of our knowledge, this paper constitutes the first survey focusing on weight initialization for deep learning models.


Improved Feature Importance Computations for Tree Models Shapley vs. Banzhaf. Shapley values are one of the main tools used to explain predictions of tree ensemble models. The main alternative to Shapley values are Banzhaf values that have not been understood equally well. In this paper we make a step towards filling this gap, providing both experimental and theoretical comparison of these model explanation methods. Surprisingly, we show that Banzhaf values offer several advantages over Shapley values while providing essentially the same explanations. We verify that Banzhaf values (1) have a more intuitive interpretation, (2) allow for more efficient algorithms, and (3) are much more numerically robust. We provide an experimental evaluation of these theses. In particular, we show that on real world instances. Additionally, from a theoretical perspective we provide new and improved algorithm computing the same Shapley value based explanations as the algorithm of Lundberg et al. Nat. Mach. Intell. 2020 . Our algorithm runs in O(TLD n) time, whereas the previous algorithm had O(TLD 2 n) running time bound. Here, T is the number of trees, L is the maximum number of leaves in a tree, and D denotes the maximum depth of a tree in the ensemble. Using the computational techniques developed for Shapley values we deliver an optimal O(TL n) time algorithm for computing Banzhaf values based explanations. In our experiments these algorithms give running times smaller even by an order of magnitude.


EgoBody Human Body Shape, Motion and Social Interactions from Head Mounted Devices. Understanding social interactions from first person views is crucial for many applications, ranging from assistive robotics to AR VR. A first step for reasoning about interactions is to understand human pose and shape. However, research in this area is currently hindered by the lack of data. Existing datasets are limited in terms of either size, annotations, ground truth capture modalities or the diversity of interactions. We address this shortcoming by proposing EgoBody, a novel large scale dataset for social interactions in complex 3D scenes. We employ Microsoft HoloLens2 headsets to record rich egocentric data streams (including RGB, depth, eye gaze, head and hand tracking). To obtain accurate 3D ground truth, we calibrate the headset with a multi Kinect rig and fit expressive SMPL X body meshes to multi view RGB D frames, reconstructing 3D human poses and shapes relative to the scene. We collect 68 sequences, spanning diverse sociological interaction categories, and propose the first benchmark for 3D full body pose and shape estimation from egocentric views. Our dataset and code will be available for research at https sanweiliti.github.io egobody egobody.html.


On the location of zeros of the Laplacian matching polynomials of graphs. The Laplacian matching polynomial of a graph G , denoted by mathscr L hspace 0.7mm M (G,x) , is a new graph polynomial whose all roots are nonnegative real numbers. In this paper, we investigate the location of zeros of the Laplacian matching polynomials. Let G be a connected graph. We show that 0 is a root of mathscr L hspace 0.7mm M (G, x) if and only if G is a tree. We prove that the number of distinct positive zeros of mathscr L hspace 0.7mm M (G,x) is at least equal to the length of the longest path in G . It is also established that the zeros of mathscr L hspace 0.7mm M (G,x) and mathscr L hspace 0.7mm M (G e,x) interlace for each edge e of G . Using the path tree of G , we present a linear algebraic approach to investigate the largest zero of mathscr L hspace 0.7mm M (G,x) and particularly to give tight upper and lower bounds on it.


Integer Only Neural Network Quantization Scheme Based on Shift Batch Normalization. Neural networks are very popular in many areas, but great computing complexity makes it hard to run neural networks on devices with limited resources. To address this problem, quantization methods are used to reduce model size and computation cost, making it possible to use neural networks on embedded platforms or mobile devices. In this paper, an integer only quantization scheme is introduced. This scheme uses one layer that combines shift based batch normalization and uniform quantization to implement 4 bit integer only inference. Without big integer multiplication(which is used in previous integer only quantization methods), this scheme can achieve good power and latency efficiency, and is especially suitable to be deployed on co designed hardware platforms. Tests have proved that this scheme works very well for easy tasks. And for tough tasks, performance loss can be tolerated for its inference efficiency. Our work is available on github https github.com hguq IntegerNet.